Apr 14 02:53:55 devstack cinder-volume[72603]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 14 02:53:55 devstack cinder-volume[72603]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 02:53:55 devstack cinder-volume[72603]: we strongly recommend against using it for new projects. Apr 14 02:53:55 devstack cinder-volume[72603]: If you are already using Eventlet, we recommend migrating to a different Apr 14 02:53:55 devstack cinder-volume[72603]: framework. For more detail see Apr 14 02:53:55 devstack cinder-volume[72603]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 02:53:55 devstack cinder-volume[72603]: import eventlet # noqa Apr 14 02:53:57 devstack cinder-volume[72603]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 02:53:57 devstack cinder-volume[72603]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 02:53:57 devstack cinder-volume[72603]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 02:53:58 devstack cinder-volume[72603]: INFO dbcounter [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Registered counter for database cinder Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72603) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG dbcounter [-] [72603] Writer thread running {{(pid=72603) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 02:53:58 devstack cinder-volume[72603]: INFO cinder.rpc [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 02:53:58 devstack cinder-volume[72603]: INFO cinder.rpc [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72603) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:53:58 devstack cinder-volume[72603]: INFO cinder.volume.manager [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Determined volume DB was empty at startup. Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG cinder.volume.manager [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72603) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 14 02:53:58 devstack cinder-volume[72603]: INFO cinder.volume.manager [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 14 02:53:58 devstack cinder-volume[72603]: WARNING stevedore.named [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 02:53:58 devstack cinder-volume[72603]: WARNING castellan.key_manager [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:53:58 devstack cinder-volume[72603]: WARNING cinder.keymgr.conf_key_mgr [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG cinder.volume.drivers.lvm [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72603) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_concurrency.processutils [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_concurrency.processutils [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] CMD "cinder-rtstool verify" returned: 0 in 0.256s {{(pid=72603) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72603) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:53:58 devstack cinder-volume[72603]: INFO cinder.rpc [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 14 02:53:58 devstack cinder-volume[72603]: INFO cinder.rpc [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 14 02:53:58 devstack cinder-volume[72603]: WARNING stevedore.named [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 02:53:58 devstack cinder-volume[72603]: WARNING castellan.key_manager [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:53:58 devstack cinder-volume[72603]: INFO cinder.volume.manager [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72603) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:53:58 devstack cinder-volume[72603]: INFO oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Starting 1 workers Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Started child 72704 {{(pid=72603) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Full set of CONF: {{(pid=72603) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] ******************************************************************************** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Configuration options gathered from: {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] ================================================================================ {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] allow_availability_zone_fallback = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] allow_compression_on_image_upload = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] allowed_direct_url_schemes = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] api_rate_limit = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] auth_strategy = keystone {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72704]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] az_cache_duration = 3600 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_availability_zone = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_host = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_stats_polling_interval = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backup_api_class = cinder.backup.api.API {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backup_name_template = backup-%s {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backup_use_same_host = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backup_use_temp_snapshot = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] chap_password = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] chap_username = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_internal_tenant_project_id = 24750c27da644fb5ab45791ab0c70ab4 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_internal_tenant_user_id = 24faac608e744524a773646e3f80f3a7 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cloned_volume_same_az = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cluster = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] compression_format = gzip {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] compute_api_class = cinder.compute.nova.API {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] config_dir = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] config_source = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] control_exchange = openstack {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] debug = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] default_availability_zone = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] default_group_type = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] default_volume_type = lvmdriver-1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] disk_geometry = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] driver_client_cert = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] driver_client_cert_key = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] driver_data_namespace = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] driver_ssl_cert_path = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] driver_ssl_cert_verify = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] driver_use_ssl = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] enable_force_upload = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] enable_new_services = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] enable_unsupported_driver = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] enabled_backends = ['lvmdriver-1'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] enforce_multipath_for_image_xfer = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] filter_function = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_api_insecure = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_api_ssl_compression = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_ca_certificates_file = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_catalog_info = image:glance:publicURL {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_certfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_keyfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_num_retries = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance_request_timeout = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] goodness_function = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] graceful_shutdown_timeout = 5 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] group_api_class = cinder.group.api.API {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] host = devstack {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_compress_on_upload = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_conversion_address_space_limit = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_conversion_cpu_limit = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_conversion_disable = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_upload_use_cinder_backend = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_upload_use_internal_tenant = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_volume_cache_enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_volume_cache_max_count = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] image_volume_cache_max_size_gb = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] init_host_max_objects_retrieval = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] instance_format = [instance: %(uuid)s] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] iscsi_target_flags = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] iscsi_write_cache = on {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] iser_helper = tgtadm {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] iser_ip_address = 192.168.122.94 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] iser_port = 3260 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_color = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_config_append = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_dir = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_file = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_options = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_rotate_interval = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_rotate_interval_type = days {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] log_rotation_type = none {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] max_age = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] max_logfile_count = 30 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] max_logfile_size_mb = 200 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] max_over_subscription_ratio = 20.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] message_reap_interval = 86400 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] message_ttl = 2592000 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] migration_create_volume_timeout_secs = 300 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] monkey_patch = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] monkey_patch_modules = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] my_ip = 192.168.122.94 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] no_snapshot_gb_quota = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] num_iser_scan_tries = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] num_shell_tries = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] num_volume_device_scan_tries = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] nvmeof_conn_info_version = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] nvmet_ns_id = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] nvmet_port_id = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] osapi_max_limit = 1000 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] osapi_volume_ext_list = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] osapi_volume_listen = 0.0.0.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] osapi_volume_listen_port = 8776 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] osapi_volume_use_ssl = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] osapi_volume_workers = 2 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] per_volume_size_limit = -1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] periodic_fuzzy_delay = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] periodic_interval = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] project_id_regex = [0-9a-f\-]+ {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] public_endpoint = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] publish_errors = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] quota_backup_gigabytes = 1000 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] quota_backups = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] quota_gigabytes = 1000 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] quota_groups = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] quota_snapshots = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] quota_volumes = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] rate_limit_burst = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] rate_limit_except_level = CRITICAL {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] rate_limit_interval = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] reinit_driver_count = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] replication_device = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] report_discard_supported = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] report_interval = 120 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] reservation_clean_interval = 86400 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] reservation_expire = 86400 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] reserved_image_namespaces = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] reserved_percentage = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] rpc_response_timeout = 120 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] run_external_periodic_tasks = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72704]: INFO cinder.volume.manager [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] scst_target_driver = iscsi {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] scst_target_iqn_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_down_time = 720 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] shell_completion = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] snapshot_name_template = snapshot-%s {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] snapshot_same_host = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] split_loggers = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] state_path = /opt/stack/data/cinder {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] storage_availability_zone = nova {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] storage_protocol = iSCSI {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] syslog_log_facility = LOG_USER {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] target_helper = lioadm {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] target_ip_address = 192.168.122.94 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] target_port = 3260 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] target_protocol = iscsi {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] target_secondary_ip_addresses = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] trace_flags = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] transfer_api_class = cinder.transfer.api.API {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] transport_url = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] until_refresh = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] use_chap_auth = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] use_default_quota_class = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] use_journal = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] use_json = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] use_multipath_for_image_xfer = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] use_stderr = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] use_syslog = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] verify_glance_signatures = enabled {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_api_class = cinder.volume.api.API {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_backend_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_clear = zero {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_clear_ionice = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_clear_size = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_copy_bps_limit = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_dd_blocksize = 1M {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_name_template = volume-%s {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_service_inithost_offload = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volume_usage_audit_period = month {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] zoning_mode = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_concurrency.disable_process_locking = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.admin_password = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.admin_token = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.admin_user = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.auth_admin_prefix = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.auth_port = 35357 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.auth_protocol = https {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.auth_section = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.auth_type = password {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.auth_uri = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.auth_version = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.cache = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.certfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.delay_auth_decision = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.http_connect_timeout = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.identity_uri = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.include_service_catalog = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.insecure = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.interface = public {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.keyfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_password = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcache_username = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.region_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.service_token_roles_required = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.service_type = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.token_cache_time = 300 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.backend = dogpile.cache.null {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.backend_argument = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.backend_expiration_time = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.config_prefix = cache.oslo {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.debug_cache_backend = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.enable_retry_client = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.enable_socket_keepalive = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.enforce_fips_mode = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.expiration_time = 600 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.hashclient_retry_attempts = 2 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.memcache_dead_retry = 300 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.memcache_pool_maxsize = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.memcache_sasl_enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.password = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.proxies = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.redis_db = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.redis_sentinel_service_name = mymaster {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.redis_server = localhost:6379 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.retry_attempts = 2 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.retry_delay = 0.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.socket_keepalive_count = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.socket_keepalive_idle = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.socket_keepalive_interval = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.socket_timeout = 1.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.tls_allowed_ciphers = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.tls_cafile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.tls_certfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.tls_enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.tls_keyfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cache.username = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] coordination.backend_url = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.asyncio_connection = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.asyncio_slave_connection = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.backend = sqlalchemy {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.connection = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.connection_debug = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.connection_parameters = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.connection_recycle_time = 3600 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.connection_trace = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.db_inc_retry_interval = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.db_max_retries = 20 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.db_max_retry_interval = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.db_retry_interval = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.max_overflow = 50 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.max_pool_size = 5 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.max_retries = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.mysql_wsrep_sync_wait = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.pool_timeout = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.retry_interval = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.slave_connection = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.sqlite_synchronous = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.synchronous_reader = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] database.use_db_reconnect = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.connection_string = messaging:// {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.es_doc_type = notification {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.es_scroll_size = 10000 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.es_scroll_time = 2m {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.filter_error_trace = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.hmac_keys = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.sentinel_service_name = mymaster {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.socket_timeout = 0.1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.trace_requests = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler.trace_sqlalchemy = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler_jaeger.process_tags = {} {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler_jaeger.service_name_prefix = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] profiler_otlp.service_name_prefix = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.enforce_new_defaults = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: WARNING oslo_config.cfg [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.enforce_scope = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.policy_default_rule = default {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.policy_file = policy.yaml {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_policy.remote_timeout = 60.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] privsep_osbrick.group = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] privsep_osbrick.helper_command = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] privsep_osbrick.user = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_sys_admin.group = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_sys_admin.helper_command = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] cinder_sys_admin.user = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.auth_section = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.auth_type = password {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.cafile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.certfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.collect_timing = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.insecure = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.keyfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.send_service_user_token = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.split_loggers = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] service_user.timeout = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.074s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.auth_section = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.auth_type = password {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.certfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.collect_timing = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.insecure = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.keyfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.region_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.split_loggers = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] glance.timeout = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.backend_availability_zone = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.chap_password = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.chap_username = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.disk_geometry = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.driver_client_cert = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.driver_client_cert_key = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.driver_data_namespace = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.driver_use_ssl = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.enable_unsupported_driver = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.extra_capabilities = {} {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.filter_function = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.goodness_function = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.iscsi_target_flags = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.iscsi_write_cache = on {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.iser_helper = tgtadm {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.iser_port = 3260 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.lvm_mirrors = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.lvm_share_target = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.lvm_type = auto {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.num_shell_tries = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.nvmet_port_id = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.replication_device = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.report_discard_supported = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.reserved_percentage = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.scst_target_driver = iscsi {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.scst_target_iqn_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.storage_protocol = iSCSI {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.target_helper = tgtadm {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.target_port = 3260 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.target_protocol = iscsi {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.trace_flags = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.unique_fqdn_network = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.use_chap_auth = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_backend_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_clear = zero {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_clear_ionice = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_clear_size = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volume_group = cinder-volumes {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_reports.file_event_handler = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_reports.log_dir = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.backend_availability_zone = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.backend_host = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.chap_password = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.chap_username = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.chiscsi_conf = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.disk_geometry = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.driver_client_cert = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.driver_data_namespace = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.driver_use_ssl = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.extra_capabilities = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.filter_function = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.goodness_function = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.iser_helper = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.iser_ip_address = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.iser_port = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.iser_target_prefix = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.lvm_conf_file = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.lvm_mirrors = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.lvm_share_target = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.lvm_type = auto {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.num_shell_tries = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.nvmet_port_id = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.replication_device = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.report_discard_supported = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.reserved_percentage = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.scst_target_driver = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.storage_protocol = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.target_helper = lioadm {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.target_ip_address = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.target_port = 3260 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.target_protocol = iscsi {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.trace_flags = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.use_chap_auth = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_clear = zero {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_clear_size = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] lvmdriver-1.volumes_dir = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.ssl = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.ssl_version = {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:53:58 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_notifications.driver = [] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_notifications.retry = -1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] oslo_messaging_notifications.transport_url = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] key_manager.fixed_key = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.barbican_api_version = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.barbican_endpoint = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.barbican_endpoint_type = public {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.barbican_region_name = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.cafile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.certfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.collect_timing = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.insecure = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.keyfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.number_of_retries = 60 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.retry_delay = 1 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.send_service_user_token = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.split_loggers = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.timeout = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.verify_ssl = True {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican.verify_ssl_path = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.auth_section = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.auth_type = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.cafile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.certfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.collect_timing = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.insecure = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.keyfile = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.split_loggers = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] barbican_service_user.timeout = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.approle_role_id = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.approle_secret_id = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.kv_mountpoint = secret {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.kv_path = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.kv_version = 2 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack sudo[72708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.namespace = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.root_token_id = **** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.ssl_ca_crt_file = None {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.timeout = 60.0 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.use_ssl = False {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:53:58 devstack sudo[72708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:53:58 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] ******************************************************************************** {{(pid=72603) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 14 02:53:59 devstack sudo[72708]: pam_unix(sudo:session): session closed for user root Apr 14 02:53:59 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.565s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:53:59 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:53:59 devstack sudo[72866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:53:59 devstack sudo[72866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:53:59 devstack sudo[72866]: pam_unix(sudo:session): session closed for user root Apr 14 02:53:59 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.515s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:53:59 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 02:53:59 devstack cinder-volume[72704]: INFO cinder.brick.local_dev.lvm [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 14 02:53:59 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:53:59 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:53:59 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:00 devstack sudo[73056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:54:00 devstack sudo[73056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:00 devstack sudo[73056]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:00 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.524s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:00 devstack cinder-volume[72704]: DEBUG cinder.brick.local_dev.lvm [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72704) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 14 02:54:00 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:00 devstack sudo[73225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:54:00 devstack sudo[73225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:01 devstack sudo[73225]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:01 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.862s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:01 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:01 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:01 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:01 devstack sudo[73355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:54:01 devstack sudo[73355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:01 devstack sudo[73355]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:01 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:01 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:01 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:01 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:01 devstack sudo[73394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 14 02:54:01 devstack sudo[73394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:02 devstack sudo[73394]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:02 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.456s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:02 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:02 devstack sudo[73397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:54:02 devstack sudo[73397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:02 devstack sudo[73397]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:02 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:02 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:02 devstack sudo[73402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:54:02 devstack sudo[73402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:03 devstack sudo[73402]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:03 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:03 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:03 devstack sudo[73408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:54:03 devstack sudo[73408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:03 devstack sudo[73408]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:03 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:03 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:03 devstack sudo[73413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:54:03 devstack sudo[73413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:04 devstack sudo[73413]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:04 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:04 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:04 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:04 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:04 devstack sudo[73417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:54:04 devstack sudo[73417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:04 devstack sudo[73417]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:04 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:04 devstack cinder-volume[72704]: INFO cinder.volume.drivers.lvm [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 14 02:54:04 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:04 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:04 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:04 devstack sudo[73431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:54:04 devstack sudo[73431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:05 devstack sudo[73431]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:05 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:05 devstack cinder-volume[72704]: DEBUG cinder.volume.drivers.lvm [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Updating volume stats {{(pid=72704) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 02:54:05 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:05 devstack sudo[73543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:54:05 devstack sudo[73543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:05 devstack sudo[73543]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:05 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:05 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:05 devstack sudo[73546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:54:05 devstack sudo[73546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:06 devstack sudo[73546]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:06 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:06 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:06 devstack sudo[73684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:54:06 devstack sudo[73684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:06 devstack sudo[73684]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:06 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:06 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:06 devstack sudo[73691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:54:06 devstack sudo[73691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:07 devstack sudo[73691]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:07 devstack cinder-volume[72704]: INFO cinder.volume.driver [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Driver hasn't implemented _init_vendor_properties() Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG cinder.volume.driver [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72704) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG oslo_db.sqlalchemy.engines [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72704) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG dbcounter [-] [72704] Writer thread running {{(pid=72704) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG cinder.db.sqlalchemy.api [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Building query based on filter {{(pid=72704) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG cinder.image.image_utils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72704) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 14 02:54:07 devstack cinder-volume[72704]: INFO cinder.keymgr.migration [None req-ec1b1726-ea44-47e5-b922-8b1587995848 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG cinder.volume.drivers.lvm [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Updating volume stats {{(pid=72704) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:07 devstack sudo[73696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:54:07 devstack sudo[73696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:07 devstack sudo[73696]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:07 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:07 devstack sudo[73699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:54:07 devstack sudo[73699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:08 devstack sudo[73699]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:08 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:08 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:08 devstack sudo[73703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:54:08 devstack sudo[73703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:08 devstack cinder-volume[72603]: DEBUG dbcounter [-] [72603] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72603) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:54:08 devstack sudo[73703]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:08 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:08 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:08 devstack sudo[73711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:54:08 devstack sudo[73711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:09 devstack sudo[73711]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:09 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:09 devstack cinder-volume[72704]: DEBUG cinder.manager [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Notifying Schedulers of capabilities ... {{(pid=72704) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:54:09 devstack cinder-volume[72704]: INFO cinder.volume.manager [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Driver initialization completed successfully. Apr 14 02:54:09 devstack cinder-volume[72704]: INFO cinder.manager [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Initiating service 2 cleanup Apr 14 02:54:09 devstack cinder-volume[72704]: INFO cinder.manager [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Service 2 cleanup completed. Apr 14 02:54:09 devstack cinder-volume[72704]: DEBUG cinder.service [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Creating RPC server for service cinder-volume {{(pid=72704) start /opt/stack/cinder/cinder/service.py:231}} Apr 14 02:54:09 devstack cinder-volume[72704]: DEBUG cinder.service [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72704) start /opt/stack/cinder/cinder/service.py:237}} Apr 14 02:54:09 devstack cinder-volume[72704]: INFO cinder.volume.manager [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 14 02:54:09 devstack cinder-volume[72704]: DEBUG cinder.volume.drivers.lvm [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Updating volume stats {{(pid=72704) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 02:54:09 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:09 devstack sudo[73716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:54:09 devstack sudo[73716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:09 devstack sudo[73716]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:09 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:09 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:09 devstack sudo[73719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:54:09 devstack sudo[73719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:10 devstack sudo[73719]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:10 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:10 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:10 devstack sudo[73776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:54:10 devstack sudo[73776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:10 devstack sudo[73776]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:10 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:10 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:54:10 devstack sudo[73817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:54:10 devstack sudo[73817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:54:11 devstack sudo[73817]: pam_unix(sudo:session): session closed for user root Apr 14 02:54:11 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:54:11 devstack cinder-volume[72704]: INFO cinder.volume.manager [None req-309e26cb-ae2c-44a8-84a2-7bfec03a9c1f None None] Driver post RPC initialization completed successfully. Apr 14 02:54:21 devstack cinder-volume[72704]: DEBUG dbcounter [-] [72704] Writing DB stats cinder:SELECT=4 {{(pid=72704) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:54:21 devstack cinder-volume[72704]: DEBUG dbcounter [-] [72704] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72704) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:55:28 devstack cinder-volume[72704]: DEBUG oslo_service.periodic_task [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72704) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 02:55:28 devstack cinder-volume[72704]: DEBUG cinder.volume.drivers.lvm [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Updating volume stats {{(pid=72704) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 02:55:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:55:28 devstack sudo[78846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:55:28 devstack sudo[78846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:55:28 devstack sudo[78846]: pam_unix(sudo:session): session closed for user root Apr 14 02:55:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:55:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:55:28 devstack sudo[78853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:55:28 devstack sudo[78853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:55:29 devstack sudo[78853]: pam_unix(sudo:session): session closed for user root Apr 14 02:55:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:55:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:55:29 devstack sudo[78859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:55:29 devstack sudo[78859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:55:29 devstack sudo[78859]: pam_unix(sudo:session): session closed for user root Apr 14 02:55:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:55:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:55:29 devstack sudo[78862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:55:29 devstack sudo[78862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:55:29 devstack sudo[78862]: pam_unix(sudo:session): session closed for user root Apr 14 02:55:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:55:29 devstack cinder-volume[72704]: DEBUG cinder.manager [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Notifying Schedulers of capabilities ... {{(pid=72704) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:56:21 devstack cinder-volume[72704]: DEBUG dbcounter [-] [72704] Writing DB stats cinder:SELECT=1 {{(pid=72704) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:56:21 devstack cinder-volume[72704]: DEBUG dbcounter [-] [72704] Writing DB stats cinder:UPDATE=1 {{(pid=72704) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:56:28 devstack cinder-volume[72704]: DEBUG oslo_service.periodic_task [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72704) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 02:56:28 devstack cinder-volume[72704]: DEBUG cinder.volume.drivers.lvm [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Updating volume stats {{(pid=72704) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 02:56:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:56:28 devstack sudo[80720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:56:28 devstack sudo[80720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:56:28 devstack sudo[80720]: pam_unix(sudo:session): session closed for user root Apr 14 02:56:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:56:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:56:28 devstack sudo[80723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:56:28 devstack sudo[80723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:56:29 devstack sudo[80723]: pam_unix(sudo:session): session closed for user root Apr 14 02:56:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:56:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:56:29 devstack sudo[80727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:56:29 devstack sudo[80727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:56:29 devstack sudo[80727]: pam_unix(sudo:session): session closed for user root Apr 14 02:56:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:56:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:56:29 devstack sudo[80741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:56:29 devstack sudo[80741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:56:29 devstack sudo[80741]: pam_unix(sudo:session): session closed for user root Apr 14 02:56:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:56:29 devstack cinder-volume[72704]: DEBUG cinder.manager [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Notifying Schedulers of capabilities ... {{(pid=72704) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:26 devstack cinder-volume[72603]: INFO oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Caught SIGTERM, stopping children Apr 14 02:57:26 devstack cinder-volume[72603]: DEBUG oslo_concurrency.lockutils [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Acquiring lock "singleton_lock" {{(pid=72603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 02:57:26 devstack cinder-volume[72603]: DEBUG oslo_concurrency.lockutils [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Acquired lock "singleton_lock" {{(pid=72603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 02:57:26 devstack cinder-volume[72603]: DEBUG oslo_concurrency.lockutils [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Releasing lock "singleton_lock" {{(pid=72603) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 02:57:26 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Stop services. {{(pid=72603) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 14 02:57:26 devstack cinder-volume[72603]: DEBUG oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Killing children. {{(pid=72603) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 14 02:57:26 devstack cinder-volume[72603]: INFO oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Waiting on 1 children to exit Apr 14 02:57:28 devstack cinder-volume[72704]: DEBUG oslo_service.periodic_task [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72704) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 02:57:28 devstack cinder-volume[72704]: DEBUG cinder.volume.drivers.lvm [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Updating volume stats {{(pid=72704) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 14 02:57:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:28 devstack sudo[81948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 14 02:57:28 devstack sudo[81948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:28 devstack sudo[81948]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:28 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:28 devstack sudo[81951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:57:28 devstack sudo[81951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:29 devstack sudo[81951]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:29 devstack sudo[81954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 14 02:57:29 devstack sudo[81954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:29 devstack sudo[81954]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:29 devstack sudo[81957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 14 02:57:29 devstack sudo[81957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:29 devstack sudo[81957]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.processutils [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72704) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG cinder.manager [None req-bc74c102-c4cd-4664-9612-884da5ac08c2 None None] Notifying Schedulers of capabilities ... {{(pid=72704) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.lockutils [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Acquiring lock "singleton_lock" {{(pid=72704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.lockutils [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Acquired lock "singleton_lock" {{(pid=72704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 02:57:29 devstack cinder-volume[72704]: DEBUG oslo_concurrency.lockutils [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Releasing lock "singleton_lock" {{(pid=72704) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 02:57:29 devstack cinder-volume[72704]: WARNING amqp [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 14 02:57:29 devstack cinder-volume[72704]: WARNING amqp [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 14 02:57:29 devstack cinder-volume[72603]: INFO oslo_service.backend._eventlet.service [None req-8ce4b016-1d8b-4482-a482-f7389c99427e None None] Child 72704 exited with status 0 Apr 14 02:57:30 devstack cinder-volume[81960]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 14 02:57:30 devstack cinder-volume[81960]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 02:57:30 devstack cinder-volume[81960]: we strongly recommend against using it for new projects. Apr 14 02:57:30 devstack cinder-volume[81960]: If you are already using Eventlet, we recommend migrating to a different Apr 14 02:57:30 devstack cinder-volume[81960]: framework. For more detail see Apr 14 02:57:30 devstack cinder-volume[81960]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 02:57:30 devstack cinder-volume[81960]: import eventlet # noqa Apr 14 02:57:32 devstack cinder-volume[81960]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 02:57:32 devstack cinder-volume[81960]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 02:57:32 devstack cinder-volume[81960]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 02:57:32 devstack cinder-volume[81960]: INFO dbcounter [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Registered counter for database cinder Apr 14 02:57:32 devstack cinder-volume[81960]: DEBUG oslo_db.sqlalchemy.engines [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81960) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:57:32 devstack cinder-volume[81960]: DEBUG dbcounter [-] [81960] Writer thread running {{(pid=81960) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 02:57:32 devstack cinder-volume[81960]: INFO cinder.rpc [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 02:57:32 devstack cinder-volume[81960]: INFO cinder.rpc [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 02:57:32 devstack cinder-volume[81960]: DEBUG oslo_db.sqlalchemy.engines [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81960) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:57:32 devstack cinder-volume[81960]: INFO cinder.volume.manager [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Determined volume DB was empty at startup. Apr 14 02:57:32 devstack cinder-volume[81960]: DEBUG cinder.volume.manager [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81960) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 14 02:57:32 devstack cinder-volume[81960]: INFO cinder.volume.manager [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 14 02:57:32 devstack cinder-volume[81960]: WARNING stevedore.named [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 02:57:32 devstack cinder-volume[81960]: WARNING castellan.key_manager [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:57:32 devstack cinder-volume[81960]: WARNING cinder.keymgr.conf_key_mgr [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:57:33 devstack cinder-volume[81960]: INFO cinder.volume.manager [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_db.sqlalchemy.engines [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81960) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:57:33 devstack cinder-volume[81960]: INFO oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Starting 1 workers Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Started child 82078 {{(pid=81960) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Full set of CONF: {{(pid=81960) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] ******************************************************************************** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Configuration options gathered from: {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] ================================================================================ {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] allow_availability_zone_fallback = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] allow_compression_on_image_upload = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] allowed_direct_url_schemes = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] api_rate_limit = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] auth_strategy = keystone {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_availability_zone = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_host = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_stats_polling_interval = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backup_api_class = cinder.backup.api.API {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backup_name_template = backup-%s {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backup_use_same_host = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backup_use_temp_snapshot = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] chap_password = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] chap_username = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_internal_tenant_project_id = 24750c27da644fb5ab45791ab0c70ab4 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_internal_tenant_user_id = 24faac608e744524a773646e3f80f3a7 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cluster = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] compression_format = gzip {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] compute_api_class = cinder.compute.nova.API {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] config_dir = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] config_source = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] control_exchange = openstack {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] debug = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] default_availability_zone = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] default_group_type = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] default_volume_type = QuobyteHD {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] disk_geometry = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] driver_client_cert = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] driver_client_cert_key = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] driver_data_namespace = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] driver_ssl_cert_path = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] driver_ssl_cert_verify = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] driver_use_ssl = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] enable_new_services = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] enable_unsupported_driver = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] enabled_backends = ['QuobyteHD'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] enforce_multipath_for_image_xfer = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] filter_function = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_api_insecure = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_api_ssl_compression = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_ca_certificates_file = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_catalog_info = image:glance:publicURL {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_certfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_keyfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_num_retries = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance_request_timeout = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] goodness_function = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] graceful_shutdown_timeout = 5 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] group_api_class = cinder.group.api.API {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] host = devstack {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_compress_on_upload = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_conversion_address_space_limit = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_conversion_cpu_limit = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[82078]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_conversion_disable = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_upload_use_cinder_backend = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_upload_use_internal_tenant = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_volume_cache_enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_volume_cache_max_count = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] image_volume_cache_max_size_gb = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] init_host_max_objects_retrieval = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] instance_format = [instance: %(uuid)s] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] iscsi_target_flags = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] iscsi_write_cache = on {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] iser_helper = tgtadm {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] iser_ip_address = 192.168.122.94 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] iser_port = 3260 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_color = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_config_append = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_dir = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_file = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_options = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_rotate_interval = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_rotate_interval_type = days {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] log_rotation_type = none {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] max_age = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] max_logfile_count = 30 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] max_logfile_size_mb = 200 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] max_over_subscription_ratio = 20.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] message_reap_interval = 86400 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] message_ttl = 2592000 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] migration_create_volume_timeout_secs = 300 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] monkey_patch = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] monkey_patch_modules = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] my_ip = 192.168.122.94 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] no_snapshot_gb_quota = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] num_iser_scan_tries = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] num_shell_tries = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] num_volume_device_scan_tries = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] nvmeof_conn_info_version = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] nvmet_ns_id = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] nvmet_port_id = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] osapi_max_limit = 1000 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] osapi_volume_ext_list = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] osapi_volume_listen_port = 8776 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] osapi_volume_use_ssl = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] osapi_volume_workers = 2 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] per_volume_size_limit = -1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] periodic_fuzzy_delay = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] periodic_interval = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] public_endpoint = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] publish_errors = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] quota_backup_gigabytes = 1000 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] quota_backups = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] quota_gigabytes = 1000 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] quota_groups = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] quota_snapshots = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] quota_volumes = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] rate_limit_burst = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] rate_limit_except_level = CRITICAL {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] rate_limit_interval = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] reinit_driver_count = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] replication_device = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] report_discard_supported = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] report_interval = 120 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] reservation_clean_interval = 86400 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] reservation_expire = 86400 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] reserved_image_namespaces = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] reserved_percentage = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] rpc_response_timeout = 120 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] run_external_periodic_tasks = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] scst_target_driver = iscsi {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] scst_target_iqn_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_down_time = 720 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] shell_completion = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] snapshot_name_template = snapshot-%s {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] split_loggers = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] state_path = /opt/stack/data/cinder {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] storage_availability_zone = nova {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] storage_protocol = iSCSI {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] syslog_log_facility = LOG_USER {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] target_helper = lioadm {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] target_ip_address = 192.168.122.94 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] target_port = 3260 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] target_protocol = iscsi {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] target_secondary_ip_addresses = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] trace_flags = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] transport_url = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] until_refresh = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] use_chap_auth = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] use_default_quota_class = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] use_journal = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] use_json = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] use_multipath_for_image_xfer = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] use_stderr = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] use_syslog = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] verify_glance_signatures = enabled {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_api_class = cinder.volume.api.API {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_backend_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_clear = zero {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_clear_ionice = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_clear_size = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_copy_bps_limit = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_dd_blocksize = 1M {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_name_template = volume-%s {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_service_inithost_offload = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volume_usage_audit_period = month {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] zoning_mode = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.admin_password = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.admin_token = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.admin_user = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.auth_port = 35357 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.auth_protocol = https {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.auth_section = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.auth_type = password {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.auth_uri = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.auth_version = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.cache = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.certfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.identity_uri = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.include_service_catalog = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.insecure = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.interface = public {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.keyfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_password = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcache_username = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.region_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.service_type = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.backend = dogpile.cache.null {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.backend_argument = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.backend_expiration_time = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.config_prefix = cache.oslo {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.debug_cache_backend = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.enable_retry_client = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.enable_socket_keepalive = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.enforce_fips_mode = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.expiration_time = 600 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.memcache_dead_retry = 300 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.memcache_pool_maxsize = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.memcache_sasl_enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.password = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.proxies = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.redis_db = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.redis_server = localhost:6379 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.retry_attempts = 2 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.retry_delay = 0.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.socket_keepalive_count = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.socket_keepalive_idle = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.socket_keepalive_interval = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.socket_timeout = 1.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.tls_allowed_ciphers = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.tls_cafile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.tls_certfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.tls_enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.tls_keyfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cache.username = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] coordination.backend_url = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.asyncio_connection = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.asyncio_slave_connection = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.backend = sqlalchemy {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.connection = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.connection_debug = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.connection_parameters = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.connection_recycle_time = 3600 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.connection_trace = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.db_inc_retry_interval = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.db_max_retries = 20 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.db_max_retry_interval = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.db_retry_interval = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.max_overflow = 50 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.max_pool_size = 5 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.max_retries = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.pool_timeout = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.retry_interval = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.slave_connection = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.sqlite_synchronous = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.synchronous_reader = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] database.use_db_reconnect = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.connection_string = messaging:// {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.es_doc_type = notification {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.es_scroll_size = 10000 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.es_scroll_time = 2m {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.filter_error_trace = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.hmac_keys = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.sentinel_service_name = mymaster {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.socket_timeout = 0.1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.trace_requests = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler.trace_sqlalchemy = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler_jaeger.process_tags = {} {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] profiler_otlp.service_name_prefix = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.enforce_new_defaults = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: WARNING oslo_config.cfg [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.enforce_scope = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.policy_default_rule = default {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.policy_file = policy.yaml {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] privsep_osbrick.group = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] privsep_osbrick.helper_command = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] privsep_osbrick.user = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_sys_admin.group = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_sys_admin.helper_command = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] cinder_sys_admin.user = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.auth_section = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.auth_type = password {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.cafile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.certfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.collect_timing = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.insecure = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.keyfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.send_service_user_token = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.split_loggers = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] service_user.timeout = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.auth_section = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.auth_type = password {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.certfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.collect_timing = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.insecure = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.keyfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.region_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.split_loggers = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] glance.timeout = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.backend_availability_zone = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.chap_password = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.chap_username = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.disk_geometry = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.driver_client_cert = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.driver_client_cert_key = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.driver_data_namespace = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.driver_use_ssl = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.extra_capabilities = {} {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.filter_function = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.goodness_function = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.iscsi_target_flags = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.iscsi_write_cache = on {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.iser_helper = tgtadm {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.iser_port = 3260 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_host = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_login = admin {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_mount_options = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_password = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_private_key = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_share_path = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.num_shell_tries = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.quobyte_volume_url = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.replication_device = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.report_discard_supported = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.reserved_percentage = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.target_helper = tgtadm {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.target_port = 3260 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.target_protocol = iscsi {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.trace_flags = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.unique_fqdn_network = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.use_chap_auth = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volume_backend_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volume_clear = zero {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volume_clear_ionice = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volume_clear_size = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_reports.file_event_handler = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_reports.log_dir = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.backend_availability_zone = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[82078]: INFO cinder.volume.manager [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Starting volume driver QuobyteDriver (1.1.14) Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.backend_host = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.chap_password = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.chap_username = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.chiscsi_conf = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.disk_geometry = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.driver_client_cert = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.driver_data_namespace = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.driver_use_ssl = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.extra_capabilities = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.filter_function = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.goodness_function = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.iser_helper = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.iser_ip_address = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.iser_port = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.iser_target_prefix = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_host = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_login = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_mount_options = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_password = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_private_key = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_share_path = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_ssh_port = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.num_shell_tries = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.nvmet_port_id = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.replication_device = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.report_discard_supported = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.reserved_percentage = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.scst_target_driver = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.storage_protocol = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.target_helper = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.target_ip_address = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.target_port = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.target_prefix = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.target_protocol = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.trace_flags = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.use_chap_auth = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volume_clear = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volume_clear_size = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] QuobyteHD.volumes_dir = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.remotefs [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82078) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.ssl = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_notifications.driver = [] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] key_manager.fixed_key = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.barbican_api_version = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.barbican_endpoint = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.barbican_endpoint_type = public {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.barbican_region_name = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.cafile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.certfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.collect_timing = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.insecure = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.keyfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.number_of_retries = 60 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.retry_delay = 1 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.send_service_user_token = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.split_loggers = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.timeout = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.verify_ssl = True {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican.verify_ssl_path = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.auth_section = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.auth_type = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.cafile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.certfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.collect_timing = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.insecure = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.keyfile = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.split_loggers = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] barbican_service_user.timeout = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.approle_role_id = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.approle_secret_id = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.kv_mountpoint = secret {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.kv_path = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.kv_version = 2 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.namespace = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.root_token_id = **** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.ssl_ca_crt_file = None {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.timeout = 60.0 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.use_ssl = False {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:33 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] ******************************************************************************** {{(pid=81960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82078) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 14 02:57:33 devstack cinder-volume[82078]: WARNING cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 14 02:57:33 devstack cinder-volume[82078]: WARNING cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Running cmd (subprocess): mount.quobyte {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:33 devstack quobyte-client[82079]: Reading configuration file: /etc/quobyte/client.cfg Apr 14 02:57:33 devstack quobyte-client[82079]: Invalid parameters found, error: missing mount point. Apr 14 02:57:33 devstack quobyte-client[82079]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 14 02:57:33 devstack quobyte-client[82079]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82078) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:57:33 devstack cinder-volume[82078]: INFO cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c ... Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 -c /etc/quobyte/client-cinder.cfg {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:33 devstack sudo[82080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 -c /etc/quobyte/client-cinder.cfg Apr 14 02:57:33 devstack sudo[82080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:33 devstack sudo[82080]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.512s {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:33 devstack cinder-volume[82078]: INFO cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c succeeded Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82078) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.536s {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:57:33 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:33 devstack sudo[82149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:57:33 devstack sudo[82149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:34 devstack sudo[82149]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.409s {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:34 devstack cinder-volume[82078]: INFO cinder.volume.driver [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Driver hasn't implemented _init_vendor_properties() Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.volume.driver [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82078) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_db.sqlalchemy.engines [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82078) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG dbcounter [-] [82078] Writer thread running {{(pid=82078) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.db.sqlalchemy.api [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Building query based on filter {{(pid=82078) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.image.image_utils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82078) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 14 02:57:34 devstack cinder-volume[82078]: INFO cinder.keymgr.migration [None req-44850bb3-9d88-45e1-bf82-afb37b58b2dd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82078) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82078) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:34 devstack sudo[82152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:57:34 devstack sudo[82152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:34 devstack sudo[82152]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.419s {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.manager [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Notifying Schedulers of capabilities ... {{(pid=82078) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:34 devstack cinder-volume[82078]: INFO cinder.volume.manager [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Driver initialization completed successfully. Apr 14 02:57:34 devstack cinder-volume[82078]: INFO cinder.manager [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Initiating service 3 cleanup Apr 14 02:57:34 devstack cinder-volume[82078]: INFO cinder.manager [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Service 3 cleanup completed. Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.service [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Creating RPC server for service cinder-volume {{(pid=82078) start /opt/stack/cinder/cinder/service.py:231}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.service [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82078) start /opt/stack/cinder/cinder/service.py:237}} Apr 14 02:57:34 devstack cinder-volume[82078]: INFO cinder.volume.manager [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82078) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82078) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:57:34 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:34 devstack sudo[82184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:57:34 devstack sudo[82184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:35 devstack sudo[82184]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:35 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.659s {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:35 devstack cinder-volume[82078]: INFO cinder.volume.manager [None req-0fc2a044-0f21-4822-a132-d07dcbfa378e None None] Driver post RPC initialization completed successfully. Apr 14 02:57:37 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-1119e410-ca06-48d2-8b53-8229806a6961 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:57:37 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-1119e410-ca06-48d2-8b53-8229806a6961 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:57:37 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-1119e410-ca06-48d2-8b53-8229806a6961 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82078) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:57:37 devstack cinder-volume[82078]: DEBUG cinder.volume.drivers.quobyte [None req-1119e410-ca06-48d2-8b53-8229806a6961 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82078) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:57:37 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-1119e410-ca06-48d2-8b53-8229806a6961 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82078) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:57:37 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-1119e410-ca06-48d2-8b53-8229806a6961 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:37 devstack sudo[82225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:57:37 devstack sudo[82225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:37 devstack sudo[82225]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:37 devstack cinder-volume[82078]: DEBUG oslo_concurrency.processutils [None req-1119e410-ca06-48d2-8b53-8229806a6961 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.396s {{(pid=82078) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:37 devstack cinder-volume[82078]: DEBUG cinder.manager [None req-1119e410-ca06-48d2-8b53-8229806a6961 None None] Notifying Schedulers of capabilities ... {{(pid=82078) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:41 devstack cinder-volume[81960]: INFO oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Caught SIGTERM, stopping children Apr 14 02:57:41 devstack cinder-volume[81960]: DEBUG oslo_concurrency.lockutils [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Acquiring lock "singleton_lock" {{(pid=81960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 02:57:41 devstack cinder-volume[81960]: DEBUG oslo_concurrency.lockutils [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Acquired lock "singleton_lock" {{(pid=81960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 02:57:41 devstack cinder-volume[81960]: DEBUG oslo_concurrency.lockutils [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Releasing lock "singleton_lock" {{(pid=81960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 02:57:41 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Stop services. {{(pid=81960) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 14 02:57:41 devstack cinder-volume[81960]: DEBUG oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Killing children. {{(pid=81960) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 14 02:57:41 devstack cinder-volume[81960]: INFO oslo_service.backend._eventlet.service [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Waiting on 1 children to exit Apr 14 02:57:45 devstack cinder-volume[82078]: DEBUG dbcounter [-] [82078] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82078) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:57:45 devstack cinder-volume[82078]: DEBUG dbcounter [-] [82078] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82078) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:57:46 devstack cinder-volume[82078]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 14 02:57:46 devstack cinder-volume[82340]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 14 02:57:46 devstack cinder-volume[82340]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 02:57:46 devstack cinder-volume[82340]: we strongly recommend against using it for new projects. Apr 14 02:57:46 devstack cinder-volume[82340]: If you are already using Eventlet, we recommend migrating to a different Apr 14 02:57:46 devstack cinder-volume[82340]: framework. For more detail see Apr 14 02:57:46 devstack cinder-volume[82340]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 02:57:46 devstack cinder-volume[82340]: import eventlet # noqa Apr 14 02:57:48 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Acquiring lock "singleton_lock" {{(pid=82078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 02:57:48 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Acquired lock "singleton_lock" {{(pid=82078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 02:57:48 devstack cinder-volume[82078]: DEBUG oslo_concurrency.lockutils [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Releasing lock "singleton_lock" {{(pid=82078) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 02:57:48 devstack cinder-volume[82078]: WARNING amqp [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 14 02:57:48 devstack cinder-volume[82078]: WARNING amqp [None req-23dacd87-8ce9-4d86-aa23-e55d9b9f76c1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 14 02:57:48 devstack cinder-volume[82340]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 14 02:57:48 devstack cinder-volume[82340]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 14 02:57:48 devstack cinder-volume[82340]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82340) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 14 02:57:48 devstack cinder-volume[82340]: INFO dbcounter [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Registered counter for database cinder Apr 14 02:57:48 devstack cinder-volume[82340]: DEBUG oslo_db.sqlalchemy.engines [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:57:48 devstack cinder-volume[82340]: DEBUG dbcounter [-] [82340] Writer thread running {{(pid=82340) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 02:57:48 devstack cinder-volume[82340]: INFO cinder.rpc [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 02:57:48 devstack cinder-volume[82340]: INFO cinder.rpc [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_db.sqlalchemy.engines [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:57:49 devstack cinder-volume[82340]: INFO cinder.volume.manager [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Determined volume DB was empty at startup. Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG cinder.volume.manager [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82340) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 14 02:57:49 devstack cinder-volume[82340]: WARNING stevedore.named [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 02:57:49 devstack cinder-volume[82340]: WARNING castellan.key_manager [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:57:49 devstack cinder-volume[82340]: WARNING cinder.keymgr.conf_key_mgr [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 02:57:49 devstack cinder-volume[82340]: INFO cinder.volume.manager [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_db.sqlalchemy.engines [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82340) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:57:49 devstack cinder-volume[82340]: INFO oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Starting 1 workers Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Started child 82473 {{(pid=82340) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Full set of CONF: {{(pid=82340) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] ******************************************************************************** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Configuration options gathered from: {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] ================================================================================ {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] allow_availability_zone_fallback = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] allow_compression_on_image_upload = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] allowed_direct_url_schemes = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82473]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] api_rate_limit = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] auth_strategy = keystone {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_availability_zone = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_host = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_stats_polling_interval = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backup_api_class = cinder.backup.api.API {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backup_name_template = backup-%s {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backup_use_same_host = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backup_use_temp_snapshot = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] chap_password = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] chap_username = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_internal_tenant_project_id = 24750c27da644fb5ab45791ab0c70ab4 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_internal_tenant_user_id = 24faac608e744524a773646e3f80f3a7 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cluster = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] compression_format = gzip {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] compute_api_class = cinder.compute.nova.API {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] config_dir = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] config_source = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] control_exchange = openstack {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] debug = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] default_availability_zone = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] default_group_type = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] default_volume_type = QuobyteHD {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] disk_geometry = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] driver_client_cert = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] driver_client_cert_key = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] driver_data_namespace = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] driver_ssl_cert_path = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] driver_ssl_cert_verify = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] driver_use_ssl = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] enable_new_services = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] enable_unsupported_driver = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] enabled_backends = ['QuobyteHD'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] enforce_multipath_for_image_xfer = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] filter_function = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_api_insecure = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_api_ssl_compression = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_ca_certificates_file = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_catalog_info = image:glance:publicURL {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_certfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_keyfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_num_retries = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance_request_timeout = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] goodness_function = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] graceful_shutdown_timeout = 5 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] group_api_class = cinder.group.api.API {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] host = devstack {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_compress_on_upload = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_conversion_address_space_limit = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_conversion_cpu_limit = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_conversion_disable = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_upload_use_cinder_backend = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_upload_use_internal_tenant = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_volume_cache_enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_volume_cache_max_count = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] image_volume_cache_max_size_gb = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] init_host_max_objects_retrieval = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] instance_format = [instance: %(uuid)s] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] iscsi_target_flags = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] iscsi_write_cache = on {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] iser_helper = tgtadm {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] iser_ip_address = 192.168.122.94 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] iser_port = 3260 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_color = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_config_append = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_dir = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_file = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_options = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_rotate_interval = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_rotate_interval_type = days {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] log_rotation_type = none {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] max_age = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] max_logfile_count = 30 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] max_logfile_size_mb = 200 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] max_over_subscription_ratio = 20.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] message_reap_interval = 86400 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] message_ttl = 2592000 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] migration_create_volume_timeout_secs = 300 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] monkey_patch = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Starting volume driver QuobyteDriver (1.1.14) Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] monkey_patch_modules = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82473) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] my_ip = 192.168.122.94 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] no_snapshot_gb_quota = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] num_iser_scan_tries = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] num_shell_tries = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] num_volume_device_scan_tries = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] nvmeof_conn_info_version = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] nvmet_ns_id = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] nvmet_port_id = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] osapi_max_limit = 1000 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] osapi_volume_ext_list = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] osapi_volume_listen_port = 8776 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] osapi_volume_use_ssl = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] osapi_volume_workers = 2 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] per_volume_size_limit = -1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] periodic_fuzzy_delay = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] periodic_interval = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] public_endpoint = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] publish_errors = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] quota_backup_gigabytes = 1000 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] quota_backups = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] quota_gigabytes = 1000 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] quota_groups = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] quota_snapshots = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] quota_volumes = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] rate_limit_burst = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] rate_limit_except_level = CRITICAL {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] rate_limit_interval = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] reinit_driver_count = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] replication_device = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] report_discard_supported = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] report_interval = 120 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] reservation_clean_interval = 86400 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] reservation_expire = 86400 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] reserved_image_namespaces = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] reserved_percentage = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] rpc_response_timeout = 120 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] run_external_periodic_tasks = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] scst_target_driver = iscsi {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] scst_target_iqn_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_down_time = 720 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] shell_completion = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] snapshot_name_template = snapshot-%s {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] split_loggers = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] state_path = /opt/stack/data/cinder {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] storage_availability_zone = nova {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] storage_protocol = iSCSI {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] syslog_log_facility = LOG_USER {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] target_helper = lioadm {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] target_ip_address = 192.168.122.94 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] target_port = 3260 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] target_protocol = iscsi {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] target_secondary_ip_addresses = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] trace_flags = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] transport_url = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] until_refresh = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] use_chap_auth = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] use_default_quota_class = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] use_journal = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] use_json = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] use_multipath_for_image_xfer = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] use_stderr = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] use_syslog = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] verify_glance_signatures = enabled {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_api_class = cinder.volume.api.API {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_backend_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_clear = zero {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_clear_ionice = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_clear_size = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_copy_bps_limit = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_dd_blocksize = 1M {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_name_template = volume-%s {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_service_inithost_offload = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volume_usage_audit_period = month {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] zoning_mode = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_concurrency.disable_process_locking = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.admin_password = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.admin_token = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.admin_user = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.auth_port = 35357 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.auth_protocol = https {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.auth_section = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.auth_type = password {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.auth_uri = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.auth_version = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.cache = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.certfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.identity_uri = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.include_service_catalog = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.insecure = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.interface = public {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.keyfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_password = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcache_username = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.region_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.service_type = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.backend = dogpile.cache.null {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.backend_argument = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.backend_expiration_time = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.config_prefix = cache.oslo {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.debug_cache_backend = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.enable_retry_client = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.enable_socket_keepalive = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.enforce_fips_mode = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.expiration_time = 600 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.hashclient_retry_attempts = 2 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.memcache_dead_retry = 300 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.memcache_pool_maxsize = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.memcache_sasl_enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.password = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.proxies = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.redis_db = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.redis_server = localhost:6379 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.retry_attempts = 2 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.retry_delay = 0.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.socket_keepalive_count = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.socket_keepalive_idle = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.socket_keepalive_interval = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.socket_timeout = 1.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.tls_allowed_ciphers = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.tls_cafile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.tls_certfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.tls_enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.tls_keyfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cache.username = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] coordination.backend_url = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.asyncio_connection = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.asyncio_slave_connection = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.backend = sqlalchemy {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.connection = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.connection_debug = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.connection_parameters = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.connection_recycle_time = 3600 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82473) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.connection_trace = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.db_inc_retry_interval = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.db_max_retries = 20 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.db_max_retry_interval = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.db_retry_interval = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.max_overflow = 50 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.max_pool_size = 5 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.max_retries = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.mysql_wsrep_sync_wait = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.pool_timeout = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.retry_interval = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.slave_connection = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.sqlite_synchronous = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.synchronous_reader = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] database.use_db_reconnect = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Running cmd (subprocess): mount.quobyte {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.connection_string = messaging:// {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.es_doc_type = notification {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.es_scroll_size = 10000 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.es_scroll_time = 2m {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.filter_error_trace = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.hmac_keys = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.sentinel_service_name = mymaster {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.socket_timeout = 0.1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.trace_requests = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler.trace_sqlalchemy = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler_jaeger.process_tags = {} {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler_jaeger.service_name_prefix = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] profiler_otlp.service_name_prefix = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.enforce_new_defaults = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: WARNING oslo_config.cfg [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.enforce_scope = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.policy_default_rule = default {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.policy_file = policy.yaml {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] privsep_osbrick.group = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] privsep_osbrick.helper_command = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] privsep_osbrick.user = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_sys_admin.group = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_sys_admin.helper_command = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] cinder_sys_admin.user = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.auth_section = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.auth_type = password {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.cafile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.certfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.collect_timing = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.insecure = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.keyfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.send_service_user_token = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.split_loggers = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] service_user.timeout = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.auth_section = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.auth_type = password {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.certfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.collect_timing = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.insecure = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.keyfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.region_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.split_loggers = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] glance.timeout = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.backend_availability_zone = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.chap_password = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.chap_username = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.disk_geometry = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.driver_client_cert = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.driver_client_cert_key = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.driver_data_namespace = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.driver_use_ssl = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.extra_capabilities = {} {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.filter_function = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.goodness_function = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.iscsi_target_flags = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.iscsi_write_cache = on {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.iser_helper = tgtadm {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.iser_port = 3260 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_host = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_login = admin {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_mount_options = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_password = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_private_key = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_share_path = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.num_shell_tries = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.quobyte_volume_url = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.replication_device = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.report_discard_supported = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.reserved_percentage = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.target_helper = tgtadm {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.target_port = 3260 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.target_protocol = iscsi {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.trace_flags = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.unique_fqdn_network = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.use_chap_auth = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volume_backend_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volume_clear = zero {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volume_clear_ionice = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volume_clear_size = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_reports.file_event_handler = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_reports.log_dir = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.backend_availability_zone = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.backend_host = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.chap_password = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.chap_username = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.chiscsi_conf = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.disk_geometry = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.driver_client_cert = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.driver_data_namespace = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.driver_use_ssl = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.extra_capabilities = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.filter_function = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.goodness_function = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.iser_helper = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.iser_ip_address = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.iser_port = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.iser_target_prefix = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_host = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_login = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_mount_options = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_password = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_private_key = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack quobyte-client[82488]: Reading configuration file: /etc/quobyte/client.cfg Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_share_path = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_ssh_port = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.num_shell_tries = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack quobyte-client[82488]: Invalid parameters found, error: missing mount point. Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack quobyte-client[82488]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack quobyte-client[82488]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.nvmet_port_id = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.replication_device = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.report_discard_supported = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.reserved_percentage = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.scst_target_driver = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.storage_protocol = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.target_helper = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.target_ip_address = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.target_port = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.target_prefix = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.target_protocol = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.trace_flags = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.use_chap_auth = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volume_clear = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volume_clear_size = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] QuobyteHD.volumes_dir = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.ssl = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_notifications.driver = [] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_notifications.retry = -1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] key_manager.fixed_key = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.barbican_api_version = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.barbican_endpoint = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.barbican_endpoint_type = public {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.barbican_region_name = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.cafile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.certfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.collect_timing = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.insecure = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.keyfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.number_of_retries = 60 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.retry_delay = 1 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.send_service_user_token = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.split_loggers = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.timeout = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.verify_ssl = True {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican.verify_ssl_path = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.auth_section = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.auth_type = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.cafile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.certfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.collect_timing = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.insecure = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.keyfile = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.split_loggers = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] barbican_service_user.timeout = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.approle_role_id = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.approle_secret_id = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.kv_mountpoint = secret {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.kv_path = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.kv_version = 2 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.namespace = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.root_token_id = **** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.ssl_ca_crt_file = None {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.timeout = 60.0 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.use_ssl = False {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 14 02:57:49 devstack cinder-volume[82340]: DEBUG oslo_service.backend._eventlet.service [None req-0acb40ec-6480-4262-b4a3-ea91acf27c09 None None] ******************************************************************************** {{(pid=82340) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 14 02:57:49 devstack sudo[82503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:57:49 devstack sudo[82503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:49 devstack sudo[82503]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.416s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:49 devstack cinder-volume[82473]: INFO cinder.volume.driver [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Driver hasn't implemented _init_vendor_properties() Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.volume.driver [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82473) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_db.sqlalchemy.engines [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82473) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writer thread running {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.db.sqlalchemy.api [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Building query based on filter {{(pid=82473) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82473) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:57:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:49 devstack cinder-volume[82473]: INFO cinder.keymgr.migration [None req-da0b78e0-53ee-41df-ab08-e5cfd9e59e4f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 02:57:49 devstack sudo[82538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:57:49 devstack sudo[82538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:50 devstack sudo[82538]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.408s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:57:50 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Driver initialization completed successfully. Apr 14 02:57:50 devstack cinder-volume[82473]: INFO cinder.manager [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Initiating service 3 cleanup Apr 14 02:57:50 devstack cinder-volume[82473]: INFO cinder.manager [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Service 3 cleanup completed. Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG cinder.service [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Creating RPC server for service cinder-volume {{(pid=82473) start /opt/stack/cinder/cinder/service.py:231}} Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG cinder.service [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82473) start /opt/stack/cinder/cinder/service.py:237}} Apr 14 02:57:50 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:57:50 devstack sudo[82561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:57:50 devstack sudo[82561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:57:50 devstack sudo[82561]: pam_unix(sudo:session): session closed for user root Apr 14 02:57:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.387s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:57:50 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-35768b11-0f6d-4e79-bb90-53b490c55f7e None None] Driver post RPC initialization completed successfully. Apr 14 02:57:59 devstack cinder-volume[82340]: DEBUG dbcounter [-] [82340] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82340) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:58:00 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:58:00 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=2 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Flow 'volume_create_manager' (528c6791-dc58-4690-ad79-3a836bbdcbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7792bc4-59c1-4fe1-8429-1ddc59d9903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7792bc4-59c1-4fe1-8429-1ddc59d9903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2025445951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89727d50-18c8-467f-8251-418e9ba7d425,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5b25b07932b49658785c865a79c8e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:46Z,use_quota=True,user_id='61e429f89784458f849b9fe6ccc9d2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0184f22c-e8c6-4eac-a9fe-74c41ddaf370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0184f22c-e8c6-4eac-a9fe-74c41ddaf370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54110149-f520-4268-b052-49a0e85782e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54110149-f520-4268-b052-49a0e85782e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89727d50-18c8-467f-8251-418e9ba7d425', 'volume_name': 'volume-89727d50-18c8-467f-8251-418e9ba7d425', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1bdb0f5-d3a3-470d-bebe-9c4b1c337ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1bdb0f5-d3a3-470d-bebe-9c4b1c337ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1962ba45-b9c1-4e6a-916d-d68a7c44a95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Volume 89727d50-18c8-467f-8251-418e9ba7d425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89727d50-18c8-467f-8251-418e9ba7d425', 'volume_size': 1} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2025445951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89727d50-18c8-467f-8251-418e9ba7d425,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5b25b07932b49658785c865a79c8e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:46Z,use_quota=True,user_id='61e429f89784458f849b9fe6ccc9d2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Creating volume 89727d50-18c8-467f-8251-418e9ba7d425 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:58:46 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:46 devstack sudo[82822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 1073741824 Apr 14 02:58:46 devstack sudo[82822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Flow 'volume_create_manager' (c686cc4e-56e2-4c60-97b4-2d862c5a14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619765c4-915b-4a32-93bd-76ee51bf0904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619765c4-915b-4a32-93bd-76ee51bf0904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:58:43Z,deleted=False,deleted_at=None,display_description='',display_name='6621e035-495d-4722-b62f-3f803a3fd8f0-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd3103d-cb77-463d-9a94-84891ea19efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9aab2ad9f4cd2874b6e4681e55dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:46Z,use_quota=True,user_id='87d155729d614ff5b14eec77a174f417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aa0b3a-8d00-495f-a95a-f1915ca905d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aa0b3a-8d00-495f-a95a-f1915ca905d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6e63ec-188b-41f5-bd78-aeecad02bc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6e63ec-188b-41f5-bd78-aeecad02bc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd3103d-cb77-463d-9a94-84891ea19efa', 'volume_name': 'volume-7fd3103d-cb77-463d-9a94-84891ea19efa', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73022912-2bea-44f5-9aff-27c7abfb83c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73022912-2bea-44f5-9aff-27c7abfb83c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395e9ee8-012f-407e-926c-7111658dd870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:46 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Volume 7fd3103d-cb77-463d-9a94-84891ea19efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd3103d-cb77-463d-9a94-84891ea19efa', 'volume_size': 1} Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:46 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-73f06423-70a1-4794-9c42-6bacf302610a tempest-GroupSnapshotsV319Test-854244747 None] Group tempest-GroupSnapshotsV319Test-Group-1803987191: creating Apr 14 02:58:46 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-73f06423-70a1-4794-9c42-6bacf302610a tempest-GroupSnapshotsV319Test-854244747 None] Group tempest-GroupSnapshotsV319Test-Group-1803987191: created successfully Apr 14 02:58:46 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-73f06423-70a1-4794-9c42-6bacf302610a tempest-GroupSnapshotsV319Test-854244747 None] Create group completed successfully. Apr 14 02:58:46 devstack sudo[82822]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 1073741824" returned: 0 in 0.697s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:47 devstack sudo[83148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 Apr 14 02:58:47 devstack sudo[83148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:47 devstack sudo[83148]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425" returned: 0 in 0.653s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:58:43Z,deleted=False,deleted_at=None,display_description='',display_name='6621e035-495d-4722-b62f-3f803a3fd8f0-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd3103d-cb77-463d-9a94-84891ea19efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9aab2ad9f4cd2874b6e4681e55dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:46Z,use_quota=True,user_id='87d155729d614ff5b14eec77a174f417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Creating volume 7fd3103d-cb77-463d-9a94-84891ea19efa {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:58:47 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1962ba45-b9c1-4e6a-916d-d68a7c44a95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89727d50-18c8-467f-8251-418e9ba7d425', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56763cc5-7cb1-441c-9071-a15fec7b436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:47 devstack sudo[83153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa 1073741824 Apr 14 02:58:47 devstack sudo[83153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:47 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Volume volume-89727d50-18c8-467f-8251-418e9ba7d425 (89727d50-18c8-467f-8251-418e9ba7d425): created successfully Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56763cc5-7cb1-441c-9071-a15fec7b436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Flow 'volume_create_manager' (528c6791-dc58-4690-ad79-3a836bbdcbac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:47 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ad006d6c-674f-414c-92ad-77684d19121f tempest-VolumesTestJSON-1358921914 None] Created volume successfully. Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Flow 'volume_create_manager' (11127a12-6736-4732-9d20-4905f2526b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2856a-f418-44be-97cc-657e6fd63dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2856a-f418-44be-97cc-657e6fd63dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1940061249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5399f0ce-0bf8-4c97-bf41-7fd20c1349b1,host='devstack@QuobyteHD#QuobyteHD',id=9e804983-6894-4432-96b4-15bdc9dc3eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece9e4662c974acfaf80dcb0c9219c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:48Z,use_quota=True,user_id='3d6fdef675a24c9490e8ca23c2e7d9a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(568324b2-0a26-44c3-bd83-b4da2b800d7b),volume_type_id=568324b2-0a26-44c3-bd83-b4da2b800d7b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9925f0-d0a4-48e1-a655-33ee64474770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9925f0-d0a4-48e1-a655-33ee64474770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2fb822-ed30-402b-a601-d14b23e776a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2fb822-ed30-402b-a601-d14b23e776a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e804983-6894-4432-96b4-15bdc9dc3eb4', 'volume_name': 'volume-9e804983-6894-4432-96b4-15bdc9dc3eb4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6649c877-4da8-48f9-9e91-6f537cf98222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6649c877-4da8-48f9-9e91-6f537cf98222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce628d7-3c83-4b7e-998c-b7af7458abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:48 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Volume 9e804983-6894-4432-96b4-15bdc9dc3eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e804983-6894-4432-96b4-15bdc9dc3eb4', 'volume_size': 1} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:48 devstack sudo[83153]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa 1073741824" returned: 0 in 0.613s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:48 devstack sudo[83158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa Apr 14 02:58:48 devstack sudo[83158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:48 devstack sudo[83158]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa" returned: 0 in 0.455s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5399f0ce-0bf8-4c97-bf41-7fd20c1349b1,created_at=2026-04-14T00:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1940061249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5399f0ce-0bf8-4c97-bf41-7fd20c1349b1,host='devstack@QuobyteHD#QuobyteHD',id=9e804983-6894-4432-96b4-15bdc9dc3eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece9e4662c974acfaf80dcb0c9219c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:48Z,use_quota=True,user_id='3d6fdef675a24c9490e8ca23c2e7d9a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(568324b2-0a26-44c3-bd83-b4da2b800d7b),volume_type_id=568324b2-0a26-44c3-bd83-b4da2b800d7b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Creating volume 9e804983-6894-4432-96b4-15bdc9dc3eb4 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:58:48 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:48 devstack sudo[83161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 1073741824 Apr 14 02:58:48 devstack sudo[83161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395e9ee8-012f-407e-926c-7111658dd870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd3103d-cb77-463d-9a94-84891ea19efa', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb2a487-5b24-438d-be68-dffcbd2571df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:48 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Volume volume-7fd3103d-cb77-463d-9a94-84891ea19efa (7fd3103d-cb77-463d-9a94-84891ea19efa): created successfully Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb2a487-5b24-438d-be68-dffcbd2571df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Flow 'volume_create_manager' (c686cc4e-56e2-4c60-97b4-2d862c5a14c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:48 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-ad3fc290-2047-4277-a6ca-32f3eb83a8c9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Created volume successfully. Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Flow 'volume_create_manager' (7e40805a-cabf-404e-bcb6-0c4090c52d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3880367-1feb-43a0-a26c-b719581596ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3880367-1feb-43a0-a26c-b719581596ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1829727534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c48dd0b-9d97-44d2-996d-fdebb18a3fcc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5b25b07932b49658785c865a79c8e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:49Z,use_quota=True,user_id='61e429f89784458f849b9fe6ccc9d2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311d2c6a-a8ab-457f-9303-0f2874c9bbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311d2c6a-a8ab-457f-9303-0f2874c9bbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461c2226-2448-49f9-968e-495818676da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461c2226-2448-49f9-968e-495818676da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c48dd0b-9d97-44d2-996d-fdebb18a3fcc', 'volume_name': 'volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc41d57-5feb-4206-88bd-a3ecb0202450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc41d57-5feb-4206-88bd-a3ecb0202450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5b12c7-0418-4219-9572-17799a785605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:49 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Volume 3c48dd0b-9d97-44d2-996d-fdebb18a3fcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc', 'volume_size': 1} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:49 devstack sudo[83161]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 1073741824" returned: 0 in 0.634s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:49 devstack sudo[83166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 Apr 14 02:58:49 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:50 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4" returned: 0 in 0.596s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1829727534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c48dd0b-9d97-44d2-996d-fdebb18a3fcc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5b25b07932b49658785c865a79c8e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:49Z,use_quota=True,user_id='61e429f89784458f849b9fe6ccc9d2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Creating volume 3c48dd0b-9d97-44d2-996d-fdebb18a3fcc {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:58:50 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce628d7-3c83-4b7e-998c-b7af7458abca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e804983-6894-4432-96b4-15bdc9dc3eb4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:50 devstack sudo[83172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc 1073741824 Apr 14 02:58:50 devstack sudo[83172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8489f0-11c0-4889-bced-eecb3b0832d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:50 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Volume volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 (9e804983-6894-4432-96b4-15bdc9dc3eb4): created successfully Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8489f0-11c0-4889-bced-eecb3b0832d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Flow 'volume_create_manager' (11127a12-6736-4732-9d20-4905f2526b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:50 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8b89d44e-8ffe-4e38-8869-05482d59f40a tempest-GroupSnapshotsV319Test-854244747 None] Created volume successfully. Apr 14 02:58:50 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] GroupSnapshot 7d90f393-1c4b-4f04-87c9-745b22444c27: creating. Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Group snapshot 7d90f393-1c4b-4f04-87c9-745b22444c27: creating. {{(pid=82473) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 14 02:58:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:51 devstack sudo[83172]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc 1073741824" returned: 0 in 1.056s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:51 devstack sudo[83191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc Apr 14 02:58:51 devstack sudo[83191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:51 devstack cinder-volume[82473]: WARNING py.warnings [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-4ca910c3-7348-4636-a63b-4a4de1096f96 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 14 02:58:51 devstack cinder-volume[82473]: .first() Apr 14 02:58:51 devstack cinder-volume[82473]: Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-4ca910c3-7348-4636-a63b-4a4de1096f96 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:51 devstack sudo[83191]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc" returned: 0 in 0.686s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5b12c7-0418-4219-9572-17799a785605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acef7c3-5a98-46b4-ad79-cf3e4c152c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:51 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Volume volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc (3c48dd0b-9d97-44d2-996d-fdebb18a3fcc): created successfully Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acef7c3-5a98-46b4-ad79-cf3e4c152c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Flow 'volume_create_manager' (7e40805a-cabf-404e-bcb6-0c4090c52d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e9981fc4-a724-4f1b-9174-3d8aaaf054c8 tempest-VolumesTestJSON-1358921914 None] Created volume successfully. Apr 14 02:58:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Creating offline snapshot 040a444c-4bca-4961-a1c6-da2133d2e549 of volume 9e804983-6894-4432-96b4-15bdc9dc3eb4 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 02:58:51 devstack cinder-volume[82473]: INFO oslo.privsep.daemon [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp39k16e7f/privsep.sock'] Apr 14 02:58:51 devstack sudo[83226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp39k16e7f/privsep.sock Apr 14 02:58:51 devstack sudo[83226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: Apr 14 02:58:52 devstack cinder-volume[82473]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Flow 'volume_create_manager' (02c989c7-0b41-4134-9c5c-9ca022898740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43108441-1e05-41f7-bc95-9d8d8a30dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43108441-1e05-41f7-bc95-9d8d8a30dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1425209240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4e7392-1e87-4e12-8a9d-843a6ac26160,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5b25b07932b49658785c865a79c8e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:53Z,use_quota=True,user_id='61e429f89784458f849b9fe6ccc9d2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1221ab64-dd3f-401a-ad7b-ac89065426b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1221ab64-dd3f-401a-ad7b-ac89065426b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a32716-eef6-40c6-a9a4-8b276e09bc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a32716-eef6-40c6-a9a4-8b276e09bc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4e7392-1e87-4e12-8a9d-843a6ac26160', 'volume_name': 'volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571db0d4-f72b-497d-bc10-16a380a79490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571db0d4-f72b-497d-bc10-16a380a79490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67240d20-9ba2-42f3-9948-2b6c619fa4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:52 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Volume cd4e7392-1e87-4e12-8a9d-843a6ac26160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160', 'volume_size': 1} Apr 14 02:58:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:53 devstack sudo[83226]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:53 devstack cinder-volume[82473]: INFO oslo.privsep.daemon [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Spawned new privsep daemon via rootwrap Apr 14 02:58:53 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Accepted privsep connection to /tmp/tmp39k16e7f/privsep.sock {{(pid=82473) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 14 02:58:53 devstack cinder-volume[82473]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 14 02:58:53 devstack cinder-volume[82473]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 14 02:58:53 devstack cinder-volume[82473]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 14 02:58:53 devstack cinder-volume[82473]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83229 Apr 14 02:58:53 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[79face8f-1ab4-4b0e-8b8e-fdae95487d61]: (2,) {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:58:53 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2fa66d-32cc-47a6-9a5b-64f49bc3eb98]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:58:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:53 devstack sudo[83231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 Apr 14 02:58:53 devstack sudo[83231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:53 devstack sudo[83231]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4" returned: 0 in 0.536s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:53 devstack sudo[83236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 1G Apr 14 02:58:53 devstack sudo[83236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:54 devstack sudo[83236]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 1G" returned: 0 in 0.511s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:54 devstack sudo[83241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 Apr 14 02:58:54 devstack sudo[83241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:54 devstack sudo[83241]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549" returned: 0 in 0.486s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:54 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 02:58:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:54 devstack sudo[83246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 Apr 14 02:58:54 devstack sudo[83246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:55 devstack sudo[83246]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549" returned: 0 in 0.530s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:55 devstack sudo[83249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.info Apr 14 02:58:55 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:55 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.info" returned: 0 in 0.488s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:55 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 02:58:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:55 devstack sudo[83252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.info Apr 14 02:58:55 devstack sudo[83252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:56 devstack sudo[83252]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.info" returned: 0 in 0.477s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.608s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-4ca910c3-7348-4636-a63b-4a4de1096f96 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.870s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:56 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae7bfd-b692-4196-9b38-c9b5eb9804ea]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:58:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-4ca910c3-7348-4636-a63b-4a4de1096f96 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:56 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-29390360-da06-4bea-8ce3-d50c2d05f1a0 tempest-GroupSnapshotsV319Test-854244747 None] group_snapshot 7d90f393-1c4b-4f04-87c9-745b22444c27: created successfully Apr 14 02:58:56 devstack sudo[83259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa Apr 14 02:58:56 devstack sudo[83259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:57 devstack sudo[83259]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-4ca910c3-7348-4636-a63b-4a4de1096f96 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa" returned: 0 in 0.522s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-4ca910c3-7348-4636-a63b-4a4de1096f96 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.533s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.043s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1425209240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4e7392-1e87-4e12-8a9d-843a6ac26160,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a5b25b07932b49658785c865a79c8e3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:58:53Z,use_quota=True,user_id='61e429f89784458f849b9fe6ccc9d2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Creating volume cd4e7392-1e87-4e12-8a9d-843a6ac26160 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:58:57 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:57 devstack sudo[83265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 1073741824 Apr 14 02:58:57 devstack sudo[83265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-4ca910c3-7348-4636-a63b-4a4de1096f96 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c', 'name': 'volume-7fd3103d-cb77-463d-9a94-84891ea19efa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6692697-e6e3-41dd-847c-d53293769a8f', 'enforce_multipath': True} {{(pid=82473) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 14 02:58:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-ed850705-f52d-443e-8e71-4c88ee161b30 req-4ca910c3-7348-4636-a63b-4a4de1096f96 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] attachment_update completed successfully. Apr 14 02:58:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] group_snapshot 7d90f393-1c4b-4f04-87c9-745b22444c27: deleting Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] group_snapshot 7d90f393-1c4b-4f04-87c9-745b22444c27: deleting {{(pid=82473) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Acquiring lock "cinder-quobyte-9e804983-6894-4432-96b4-15bdc9dc3eb4" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Lock "cinder-quobyte-9e804983-6894-4432-96b4-15bdc9dc3eb4" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Acquiring lock "cinder-quobyte-040a444c-4bca-4961-a1c6-da2133d2e549" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Lock "cinder-quobyte-040a444c-4bca-4961-a1c6-da2133d2e549" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Deleting offline snapshot 040a444c-4bca-4961-a1c6-da2133d2e549 of volume 9e804983-6894-4432-96b4-15bdc9dc3eb4 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] snapshot_file for this snap is: volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68a316-5bf6-4672-9bd6-2f425da3a257]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:57 devstack sudo[83265]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 1073741824" returned: 0 in 0.529s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:57 devstack sudo[83271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 Apr 14 02:58:57 devstack sudo[83271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:57 devstack sudo[83270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 Apr 14 02:58:57 devstack sudo[83270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:57 devstack sudo[83271]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160" returned: 0 in 0.414s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:58:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67240d20-9ba2-42f3-9948-2b6c619fa4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e455c419-6c3c-4091-bd13-5cb6bc496921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:58:58 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Volume volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 (cd4e7392-1e87-4e12-8a9d-843a6ac26160): created successfully Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e455c419-6c3c-4091-bd13-5cb6bc496921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Flow 'volume_create_manager' (02c989c7-0b41-4134-9c5c-9ca022898740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:58:58 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-be1948c3-333a-43c8-a1f0-50fdb23624f8 tempest-VolumesTestJSON-1358921914 None] Created volume successfully. Apr 14 02:58:58 devstack sudo[83270]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549" returned: 0 in 0.579s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e804983-6894-4432-96b4-15bdc9dc3eb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[620de9d2-1e48-4af8-8bce-7671dcb02f78]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:58 devstack sudo[83278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 Apr 14 02:58:58 devstack sudo[83278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:58 devstack sudo[83278]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4" returned: 0 in 0.566s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:58 devstack sudo[83283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 Apr 14 02:58:58 devstack sudo[83283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Acquiring lock "cinder-cd4e7392-1e87-4e12-8a9d-843a6ac26160-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Lock "cinder-cd4e7392-1e87-4e12-8a9d-843a6ac26160-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Acquiring lock "cinder-quobyte-cd4e7392-1e87-4e12-8a9d-843a6ac26160" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Lock "cinder-quobyte-cd4e7392-1e87-4e12-8a9d-843a6ac26160" acquired by "delete_volume" :: waited 0.016s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a502e3-d4ed-48ab-a22f-a68d6131f674]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:58:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:59 devstack sudo[83285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 Apr 14 02:58:59 devstack sudo[83285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:59 devstack sudo[83283]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:59 devstack sudo[83290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549 Apr 14 02:58:59 devstack sudo[83290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:59 devstack sudo[83285]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160" returned: 0 in 0.569s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:58:59 devstack sudo[83363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160 Apr 14 02:58:59 devstack sudo[83363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:58:59 devstack sudo[83290]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4.040a444c-4bca-4961-a1c6-da2133d2e549" returned: 0 in 0.460s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Lock "cinder-quobyte-040a444c-4bca-4961-a1c6-da2133d2e549" released by "_delete_snapshot" :: held 2.152s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Lock "cinder-quobyte-9e804983-6894-4432-96b4-15bdc9dc3eb4" released by "delete_snapshot" :: held 2.164s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:58:59 devstack cinder-volume[82473]: WARNING cinder.quota [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1667264191 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1667264191, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:59 devstack cinder-volume[82473]: WARNING cinder.quota [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1667264191 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1667264191, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] Created reservations ['0d05cd6b-760c-46bd-9c3c-d823470c115d', 'afab4867-188f-4d96-bd8d-3bd6d509c276', '2b624d45-8c3e-48ca-b4e3-6ab3c0f26185', '5e991ef5-6019-446c-9f54-3da043218cc9'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:58:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f38bf886-852f-4ee0-a0db-e57ccfc7d743 tempest-GroupSnapshotsV319Test-854244747 None] group_snapshot 7d90f393-1c4b-4f04-87c9-745b22444c27: deleted successfully Apr 14 02:58:59 devstack sudo[83363]: pam_unix(sudo:session): session closed for user root Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cd4e7392-1e87-4e12-8a9d-843a6ac26160" returned: 0 in 0.441s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Lock "cinder-quobyte-cd4e7392-1e87-4e12-8a9d-843a6ac26160" released by "delete_volume" :: held 1.039s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:58:59 devstack cinder-volume[82473]: WARNING cinder.quota [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:59 devstack cinder-volume[82473]: WARNING cinder.quota [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:58:59 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Created reservations ['5b3620c6-d7f5-4651-85bf-d98e0e8cca57', '1fdc88bb-8a53-4233-af90-a45ba7cc9cb8', '701449c3-c8ba-4088-bf12-d1ba5e48027c', '878776ef-9d80-453f-8d39-cd883a05ae45'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:00 devstack sudo[83367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:00 devstack sudo[83367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:00 devstack sudo[83367]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:00 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Deleted volume successfully. Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3bc928af-bc2f-45ec-95c1-4e2cd1f0815d tempest-VolumesTestJSON-1358921914 None] Lock "cinder-cd4e7392-1e87-4e12-8a9d-843a6ac26160-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Acquiring lock "cinder-quobyte-9e804983-6894-4432-96b4-15bdc9dc3eb4" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Lock "cinder-quobyte-9e804983-6894-4432-96b4-15bdc9dc3eb4" acquired by "delete_volume" :: waited 0.018s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5938a3e-c4ad-42f2-b6b4-58f8b328cde4]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Acquiring lock "cinder-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Lock "cinder-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:01 devstack sudo[83373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 Apr 14 02:59:01 devstack sudo[83373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Acquiring lock "cinder-quobyte-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Lock "cinder-quobyte-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[62045258-c5e1-4c75-aa91-989d692da7ea]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:01 devstack sudo[83376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc Apr 14 02:59:01 devstack sudo[83376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:01 devstack sudo[83373]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4" returned: 0 in 0.601s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:01 devstack sudo[83383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4 Apr 14 02:59:01 devstack sudo[83383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:01 devstack sudo[83376]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc" returned: 0 in 0.539s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:01 devstack sudo[83386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc Apr 14 02:59:01 devstack sudo[83386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:02 devstack sudo[83383]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9e804983-6894-4432-96b4-15bdc9dc3eb4" returned: 0 in 0.558s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Lock "cinder-quobyte-9e804983-6894-4432-96b4-15bdc9dc3eb4" released by "delete_volume" :: held 1.224s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:02 devstack sudo[83386]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc" returned: 0 in 0.529s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Lock "cinder-quobyte-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc" released by "delete_volume" :: held 1.118s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Created reservations ['de81d0c6-c156-453e-90e6-28c004f05b17'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Created reservations ['e7e617f5-bbe4-4524-8513-f0a28ed29d6b', '4e31a32e-1b54-4713-a216-ab921868d7c9', '1424e558-9e4f-4976-957a-7e29acf6f077', '7a24e323-1c58-49aa-b5fc-a07b85149b5d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:02 devstack cinder-volume[82473]: WARNING cinder.quota [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1667264191 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1667264191, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Created reservations ['b9660665-273c-48c6-9eb7-e5983175a42d', '638d412f-898b-4237-8b65-40955e0f0d90', '2b4973a3-2538-45dd-bdf4-2c6e94638a2d', '1a6b0ce1-5f89-470b-ba1e-b1fe12c073d2'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:02 devstack sudo[83728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:02 devstack sudo[83728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:02 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:02 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:03 devstack sudo[83728]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.662s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:03 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Deleted volume successfully. Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b20bd5fa-f676-4764-8d6b-f030e93f416b tempest-VolumesTestJSON-1358921914 None] Lock "cinder-3c48dd0b-9d97-44d2-996d-fdebb18a3fcc-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:03 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.722s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:03 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-288ea9c9-e281-459a-a0c3-a1e5224ec5af tempest-GroupSnapshotsV319Test-854244747 None] Delete group completed successfully. Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Acquiring lock "cinder-89727d50-18c8-467f-8251-418e9ba7d425-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Lock "cinder-89727d50-18c8-467f-8251-418e9ba7d425-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Acquiring lock "cinder-quobyte-89727d50-18c8-467f-8251-418e9ba7d425" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Lock "cinder-quobyte-89727d50-18c8-467f-8251-418e9ba7d425" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ebe65-3e9d-48c6-adef-486dc44bad25]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:03 devstack sudo[83750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 Apr 14 02:59:03 devstack sudo[83750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:03 devstack sudo[83750]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425" returned: 0 in 0.564s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:04 devstack sudo[83755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425 Apr 14 02:59:04 devstack sudo[83755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:04 devstack sudo[83755]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-89727d50-18c8-467f-8251-418e9ba7d425" returned: 0 in 0.730s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Lock "cinder-quobyte-89727d50-18c8-467f-8251-418e9ba7d425" released by "delete_volume" :: held 1.337s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Created reservations ['526e0dca-6360-48a3-8b85-9536527ec900', 'fa225dcc-e066-4338-bf05-42d0bb6321f2', '39dda3f2-4a5d-455d-b328-aa09f0992997', '4ed517ed-345f-48de-b5df-a2c1db9d4523'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:04 devstack sudo[83758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:04 devstack sudo[83758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:05 devstack sudo[83758]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.473s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:05 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:05 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Deleted volume successfully. Apr 14 02:59:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073ae776-bea7-4c42-9ddf-3af4c41cf2b9 tempest-VolumesTestJSON-1358921914 None] Lock "cinder-89727d50-18c8-467f-8251-418e9ba7d425-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Flow 'volume_create_manager' (ccc04f6e-415f-41ca-990c-6e218540624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603e8bb6-9a13-41e0-9f70-78625b4e475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603e8bb6-9a13-41e0-9f70-78625b4e475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-760609886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1e3101-951e-49da-baac-bd7f1fe569b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e648665e71c4e4eb2bbceb0377debc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:11Z,use_quota=True,user_id='a4722580ca1847649d431afe0fd6d3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc863dc-15d4-42a2-9a12-c6413cca8024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc863dc-15d4-42a2-9a12-c6413cca8024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70c5b41-5c22-4e23-bee9-0bf3efcf6307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70c5b41-5c22-4e23-bee9-0bf3efcf6307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b1e3101-951e-49da-baac-bd7f1fe569b6', 'volume_name': 'volume-9b1e3101-951e-49da-baac-bd7f1fe569b6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5235a5fa-2fdc-440e-a427-848ffdf90e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5235a5fa-2fdc-440e-a427-848ffdf90e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f50277-5754-47a8-a2e1-5807709c1448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:10 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Volume 9b1e3101-951e-49da-baac-bd7f1fe569b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b1e3101-951e-49da-baac-bd7f1fe569b6', 'volume_size': 1} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-760609886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1e3101-951e-49da-baac-bd7f1fe569b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e648665e71c4e4eb2bbceb0377debc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:11Z,use_quota=True,user_id='a4722580ca1847649d431afe0fd6d3cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Creating volume 9b1e3101-951e-49da-baac-bd7f1fe569b6 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:59:10 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:59:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:10 devstack sudo[83794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 1073741824 Apr 14 02:59:10 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:11 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 1073741824" returned: 0 in 0.725s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:11 devstack sudo[83799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 Apr 14 02:59:11 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:12 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6" returned: 0 in 0.478s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:59:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f50277-5754-47a8-a2e1-5807709c1448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1e3101-951e-49da-baac-bd7f1fe569b6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b49d43-6c5d-47fb-b37c-fc09bdc417ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:12 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Volume volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 (9b1e3101-951e-49da-baac-bd7f1fe569b6): created successfully Apr 14 02:59:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b49d43-6c5d-47fb-b37c-fc09bdc417ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Flow 'volume_create_manager' (ccc04f6e-415f-41ca-990c-6e218540624b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:12 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a24346c0-3e2b-4bb0-8a9f-d266a925f5ad tempest-VolumesAdminNegativeTest-1624491723 None] Created volume successfully. Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3956adee-f9d1-49c3-ab29-558c44018502 tempest-BackendsCapabilitiesAdminTestsJSON-1373040273 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82473) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Acquiring lock "cinder-9b1e3101-951e-49da-baac-bd7f1fe569b6-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Lock "cinder-9b1e3101-951e-49da-baac-bd7f1fe569b6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Acquiring lock "cinder-quobyte-9b1e3101-951e-49da-baac-bd7f1fe569b6" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Lock "cinder-quobyte-9b1e3101-951e-49da-baac-bd7f1fe569b6" acquired by "delete_volume" :: waited 0.019s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bff9f0-006e-43da-a4b0-f38d6a096741]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:13 devstack sudo[83803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 Apr 14 02:59:13 devstack sudo[83803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bfeb6d5b-072c-4807-be99-d6873e48eab7 tempest-BackendsCapabilitiesAdminTestsJSON-1373040273 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757999420166, 'free_capacity_gb': 1775.757999420166, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82473) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 14 02:59:13 devstack sudo[83803]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6" returned: 0 in 0.658s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:14 devstack sudo[83830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6 Apr 14 02:59:14 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:14 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9b1e3101-951e-49da-baac-bd7f1fe569b6" returned: 0 in 0.509s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Lock "cinder-quobyte-9b1e3101-951e-49da-baac-bd7f1fe569b6" released by "delete_volume" :: held 1.193s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Created reservations ['4d13f55c-507a-492b-916b-4112a6f66a13', '1378c3b2-8bf9-4f8d-a0fa-71e54331b554', '701e071a-9d63-473f-a371-ecabbe46248e', '17c95f96-878c-446f-923b-fe398275a912'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:14 devstack sudo[83833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:14 devstack sudo[83833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:14 devstack sudo[83834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:14 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:15 devstack sudo[83833]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.873s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:15 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Deleted volume successfully. Apr 14 02:59:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-241b8334-bd17-4b4c-bd44-c4195b44d673 tempest-VolumesAdminNegativeTest-1624491723 None] Lock "cinder-9b1e3101-951e-49da-baac-bd7f1fe569b6-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:15 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.896s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-41f9c582-1a96-4930-85e9-38f8f0121a44 tempest-GroupsTest-306875327 None] Group tempest-Group1-965395236: creating Apr 14 02:59:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-41f9c582-1a96-4930-85e9-38f8f0121a44 tempest-GroupsTest-306875327 None] Group tempest-Group1-965395236: created successfully Apr 14 02:59:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-41f9c582-1a96-4930-85e9-38f8f0121a44 tempest-GroupsTest-306875327 None] Create group completed successfully. Apr 14 02:59:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-202c67bd-4c08-4b31-8e7e-b6032d9ca798 tempest-GroupsTest-306875327 None] Group tempest-Group2-1996755205: creating Apr 14 02:59:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-202c67bd-4c08-4b31-8e7e-b6032d9ca798 tempest-GroupsTest-306875327 None] Group tempest-Group2-1996755205: created successfully Apr 14 02:59:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-202c67bd-4c08-4b31-8e7e-b6032d9ca798 tempest-GroupsTest-306875327 None] Create group completed successfully. Apr 14 02:59:25 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Flow 'volume_create_manager' (f6455338-c933-4c62-833d-cc90b115eb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca060d8a-0b34-4e3e-8bd4-1cfe6a652231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca060d8a-0b34-4e3e-8bd4-1cfe6a652231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622809083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=118f43a9-2b3c-49a3-bde3-808ff0ff711f,host='devstack@QuobyteHD#QuobyteHD',id=9c9b0b39-8072-4924-b52b-f39885ed0b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99dbd8555c34d49a2ab5954ba4189c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:26Z,use_quota=True,user_id='ca81954bdeac46448cd278a16f8bb460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffcb2e02-f745-4a68-a166-82bd3ecd312b),volume_type_id=ffcb2e02-f745-4a68-a166-82bd3ecd312b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e59e1f-5485-42f5-bdf9-858672aec383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e59e1f-5485-42f5-bdf9-858672aec383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e8c37b-d180-4b96-853a-9cebe7a5dc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e8c37b-d180-4b96-853a-9cebe7a5dc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9b0b39-8072-4924-b52b-f39885ed0b1f', 'volume_name': 'volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1b8220-4853-4f7f-8d83-f6151c51bb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1b8220-4853-4f7f-8d83-f6151c51bb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cc6f52-1bf3-4f85-84ad-810148cd9791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:26 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Volume 9c9b0b39-8072-4924-b52b-f39885ed0b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f', 'volume_size': 1} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=118f43a9-2b3c-49a3-bde3-808ff0ff711f,created_at=2026-04-14T00:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1622809083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=118f43a9-2b3c-49a3-bde3-808ff0ff711f,host='devstack@QuobyteHD#QuobyteHD',id=9c9b0b39-8072-4924-b52b-f39885ed0b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99dbd8555c34d49a2ab5954ba4189c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:26Z,use_quota=True,user_id='ca81954bdeac46448cd278a16f8bb460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffcb2e02-f745-4a68-a166-82bd3ecd312b),volume_type_id=ffcb2e02-f745-4a68-a166-82bd3ecd312b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Creating volume 9c9b0b39-8072-4924-b52b-f39885ed0b1f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:59:26 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:26 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f 1073741824 Apr 14 02:59:26 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:26 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f 1073741824" returned: 0 in 0.585s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:26 devstack sudo[84003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f Apr 14 02:59:26 devstack sudo[84003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:27 devstack sudo[84003]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:59:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cc6f52-1bf3-4f85-84ad-810148cd9791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530b569c-e511-42dc-8f04-6f4729212596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:27 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Volume volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f (9c9b0b39-8072-4924-b52b-f39885ed0b1f): created successfully Apr 14 02:59:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530b569c-e511-42dc-8f04-6f4729212596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Flow 'volume_create_manager' (f6455338-c933-4c62-833d-cc90b115eb5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6784dab5-3f2f-4da0-a36e-4e06eacb49e1 tempest-GroupsTest-306875327 None] Created volume successfully. Apr 14 02:59:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Acquiring lock "cinder-quobyte-9c9b0b39-8072-4924-b52b-f39885ed0b1f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Lock "cinder-quobyte-9c9b0b39-8072-4924-b52b-f39885ed0b1f" acquired by "delete_volume" :: waited 0.025s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e13016-a8af-4b33-bc90-79db9b497b9c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:28 devstack sudo[84010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f Apr 14 02:59:28 devstack sudo[84010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:29 devstack sudo[84010]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f" returned: 0 in 0.618s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:29 devstack sudo[84015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f Apr 14 02:59:29 devstack sudo[84015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:29 devstack sudo[84015]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9c9b0b39-8072-4924-b52b-f39885ed0b1f" returned: 0 in 0.544s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Lock "cinder-quobyte-9c9b0b39-8072-4924-b52b-f39885ed0b1f" released by "delete_volume" :: held 1.197s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Created reservations ['9f5a3eac-34ed-4e0c-b24b-8f0e55f7778f'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:29 devstack cinder-volume[82473]: WARNING cinder.quota [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-673106996 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-673106996, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:59:29 devstack cinder-volume[82473]: WARNING cinder.quota [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-673106996 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-673106996, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Created reservations ['941ef671-81f2-4ff1-b061-08661b4cb758', '7d5f8b5d-3f77-4531-b031-0700d817fb9d', '5f2d4ea5-b02b-43dc-b278-21080c7c1fcf', 'c7dcd0dd-a777-4bc2-a15a-c1d98759a995'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:29 devstack sudo[84019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:29 devstack sudo[84019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Flow 'volume_create_manager' (f2e0047b-6008-42bb-a770-e77da49e9431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb23b25-60fd-4da3-bf6b-30d86c434797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb23b25-60fd-4da3-bf6b-30d86c434797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1217996863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d693199e-4443-4a32-91c0-ce63d3d74dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f69d3cfcfac43f69bdd8f713d1395c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:30Z,use_quota=True,user_id='22e91f98298944289ddac62f9208204f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27cad05-62df-4203-8bba-88c57d2e8bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27cad05-62df-4203-8bba-88c57d2e8bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1457c8d4-71b5-4146-92ed-fd30148e6912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1457c8d4-71b5-4146-92ed-fd30148e6912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd693199e-4443-4a32-91c0-ce63d3d74dd6', 'volume_name': 'volume-d693199e-4443-4a32-91c0-ce63d3d74dd6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d5b70e-a2cf-4346-822e-7873a9a7fa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d5b70e-a2cf-4346-822e-7873a9a7fa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fd658a-048d-47b9-b1a2-3633320904ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:30 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Volume d693199e-4443-4a32-91c0-ce63d3d74dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d693199e-4443-4a32-91c0-ce63d3d74dd6', 'volume_size': 1} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1217996863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d693199e-4443-4a32-91c0-ce63d3d74dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f69d3cfcfac43f69bdd8f713d1395c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:30Z,use_quota=True,user_id='22e91f98298944289ddac62f9208204f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Creating volume d693199e-4443-4a32-91c0-ce63d3d74dd6 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:59:30 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:30 devstack sudo[84021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 1073741824 Apr 14 02:59:30 devstack sudo[84021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:30 devstack sudo[84019]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.452s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:30 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f304b456-0c8e-4828-b2e4-b95cf7a30e90 tempest-GroupsTest-306875327 None] Delete group completed successfully. Apr 14 02:59:30 devstack sudo[84021]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 1073741824" returned: 0 in 0.548s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:30 devstack sudo[84027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 Apr 14 02:59:30 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Created reservations ['e0890a73-095d-472a-83ca-f77c2c8011d1'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:30 devstack sudo[84030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:30 devstack sudo[84030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:31 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6" returned: 0 in 0.539s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fd658a-048d-47b9-b1a2-3633320904ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d693199e-4443-4a32-91c0-ce63d3d74dd6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e5513-fe3a-4f82-bfb3-2cebe1097797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Volume volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 (d693199e-4443-4a32-91c0-ce63d3d74dd6): created successfully Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e5513-fe3a-4f82-bfb3-2cebe1097797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Flow 'volume_create_manager' (f2e0047b-6008-42bb-a770-e77da49e9431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-917e19b8-83a5-453c-b2b9-433b3e25024b tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Created volume successfully. Apr 14 02:59:31 devstack sudo[84030]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.442s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:31 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ce8e25a0-a5ca-42c3-8264-0e2b50e154c3 tempest-GroupsTest-306875327 None] Delete group completed successfully. Apr 14 02:59:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-169082e4-3ef3-4bed-add6-61c126ba4d2b tempest-GroupsTest-306875327 None] Group tempest-GroupsTest-Group-1597682835: creating Apr 14 02:59:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-169082e4-3ef3-4bed-add6-61c126ba4d2b tempest-GroupsTest-306875327 None] Group tempest-GroupsTest-Group-1597682835: created successfully Apr 14 02:59:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-169082e4-3ef3-4bed-add6-61c126ba4d2b tempest-GroupsTest-306875327 None] Create group completed successfully. Apr 14 02:59:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Acquiring lock "cinder-d693199e-4443-4a32-91c0-ce63d3d74dd6-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "cinder-d693199e-4443-4a32-91c0-ce63d3d74dd6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Acquiring lock "cinder-quobyte-d693199e-4443-4a32-91c0-ce63d3d74dd6" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "cinder-quobyte-d693199e-4443-4a32-91c0-ce63d3d74dd6" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:32 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daa0d57-e979-4c42-afef-3c8c037527cc]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:33 devstack sudo[84035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 Apr 14 02:59:33 devstack sudo[84035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:33 devstack sudo[84035]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6" returned: 0 in 0.552s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:33 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6 Apr 14 02:59:33 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Flow 'volume_create_manager' (b710f554-64cc-4e99-b1cd-1f314d633459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd54cf4-3f9e-455f-b9ee-c7ddb580388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd54cf4-3f9e-455f-b9ee-c7ddb580388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1246500847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3adc99fa-2526-48fd-930b-cf2f283dabd8,host='devstack@QuobyteHD#QuobyteHD',id=f58e4848-19be-4aa9-8190-894c2e63cecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99dbd8555c34d49a2ab5954ba4189c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:34Z,use_quota=True,user_id='ca81954bdeac46448cd278a16f8bb460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aedf72c1-5807-44d1-8937-ebf82388e4d0),volume_type_id=aedf72c1-5807-44d1-8937-ebf82388e4d0)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdeb1000-294e-4a6a-be8c-e1425144f39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdeb1000-294e-4a6a-be8c-e1425144f39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2635cced-aaaa-42aa-b662-77292e755ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2635cced-aaaa-42aa-b662-77292e755ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f58e4848-19be-4aa9-8190-894c2e63cecc', 'volume_name': 'volume-f58e4848-19be-4aa9-8190-894c2e63cecc', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bbe52f-cb43-4ff7-b4ff-b3287fe9999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bbe52f-cb43-4ff7-b4ff-b3287fe9999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8151a109-c14d-445b-8c89-bec60c285873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:33 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Volume f58e4848-19be-4aa9-8190-894c2e63cecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f58e4848-19be-4aa9-8190-894c2e63cecc', 'volume_size': 1} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3adc99fa-2526-48fd-930b-cf2f283dabd8,created_at=2026-04-14T00:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1246500847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3adc99fa-2526-48fd-930b-cf2f283dabd8,host='devstack@QuobyteHD#QuobyteHD',id=f58e4848-19be-4aa9-8190-894c2e63cecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99dbd8555c34d49a2ab5954ba4189c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:34Z,use_quota=True,user_id='ca81954bdeac46448cd278a16f8bb460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aedf72c1-5807-44d1-8937-ebf82388e4d0),volume_type_id=aedf72c1-5807-44d1-8937-ebf82388e4d0)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Creating volume f58e4848-19be-4aa9-8190-894c2e63cecc {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:59:33 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:59:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:33 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc 1073741824 Apr 14 02:59:33 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:34 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d693199e-4443-4a32-91c0-ce63d3d74dd6" returned: 0 in 0.606s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "cinder-quobyte-d693199e-4443-4a32-91c0-ce63d3d74dd6" released by "delete_volume" :: held 1.182s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Created reservations ['a789a65b-b503-42cd-b0a4-13768a307526', '7b605a3c-ea56-4c43-9843-dc6bae9921d8', '3ecd445c-fc41-46a2-8314-242fa99b6eb3', '2503b77b-5f6a-4f40-987f-1f38778a2032'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:34 devstack sudo[84045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:34 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:34 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc 1073741824" returned: 0 in 0.682s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:34 devstack sudo[84051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc Apr 14 02:59:34 devstack sudo[84051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:34 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.544s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:34 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Deleted volume successfully. Apr 14 02:59:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3ed8d189-5bee-4b80-8d3d-d8437f133593 tempest-VolumeQuotasNegativeTestJSON-2096034327 None] Lock "cinder-d693199e-4443-4a32-91c0-ce63d3d74dd6-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:35 devstack sudo[84051]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc" returned: 0 in 0.581s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:59:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8151a109-c14d-445b-8c89-bec60c285873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58e4848-19be-4aa9-8190-894c2e63cecc', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff91489-0ae6-49e0-9dc8-f1f8a677488a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:35 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Volume volume-f58e4848-19be-4aa9-8190-894c2e63cecc (f58e4848-19be-4aa9-8190-894c2e63cecc): created successfully Apr 14 02:59:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff91489-0ae6-49e0-9dc8-f1f8a677488a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Flow 'volume_create_manager' (b710f554-64cc-4e99-b1cd-1f314d633459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e66aecfe-3969-45c0-b45d-11d544ada0d8 tempest-GroupsTest-306875327 None] Created volume successfully. Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Flow 'volume_create_manager' (7d62f36d-1a3b-4a84-89a9-70bf82ffe9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e89dba4-70cd-4880-aabb-4ce47083890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e89dba4-70cd-4880-aabb-4ce47083890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265080671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3adc99fa-2526-48fd-930b-cf2f283dabd8,host='devstack@QuobyteHD#QuobyteHD',id=bbe212cc-cb6b-4f14-9722-c0f44703c92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99dbd8555c34d49a2ab5954ba4189c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:36Z,use_quota=True,user_id='ca81954bdeac46448cd278a16f8bb460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aedf72c1-5807-44d1-8937-ebf82388e4d0),volume_type_id=aedf72c1-5807-44d1-8937-ebf82388e4d0)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33d5e0b-db89-495a-8cd8-901467d73046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33d5e0b-db89-495a-8cd8-901467d73046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062e3d29-9e23-4989-b0cf-2378384d8f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062e3d29-9e23-4989-b0cf-2378384d8f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe212cc-cb6b-4f14-9722-c0f44703c92c', 'volume_name': 'volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248b6015-b1c2-4e22-b540-bb328d74eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248b6015-b1c2-4e22-b540-bb328d74eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f90dfc-2205-4fe3-a0d2-3f33db5859a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:36 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Volume bbe212cc-cb6b-4f14-9722-c0f44703c92c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c', 'volume_size': 1} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3adc99fa-2526-48fd-930b-cf2f283dabd8,created_at=2026-04-14T00:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-265080671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3adc99fa-2526-48fd-930b-cf2f283dabd8,host='devstack@QuobyteHD#QuobyteHD',id=bbe212cc-cb6b-4f14-9722-c0f44703c92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e99dbd8555c34d49a2ab5954ba4189c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:36Z,use_quota=True,user_id='ca81954bdeac46448cd278a16f8bb460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aedf72c1-5807-44d1-8937-ebf82388e4d0),volume_type_id=aedf72c1-5807-44d1-8937-ebf82388e4d0)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Creating volume bbe212cc-cb6b-4f14-9722-c0f44703c92c {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:59:36 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:36 devstack sudo[84070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c 1073741824 Apr 14 02:59:36 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:36 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c 1073741824" returned: 0 in 0.603s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:37 devstack sudo[84076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c Apr 14 02:59:37 devstack sudo[84076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:37 devstack sudo[84076]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c" returned: 0 in 0.587s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:59:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f90dfc-2205-4fe3-a0d2-3f33db5859a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5902c8-bcd1-4d6f-b464-4b9b16c9db65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:37 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Volume volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c (bbe212cc-cb6b-4f14-9722-c0f44703c92c): created successfully Apr 14 02:59:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5902c8-bcd1-4d6f-b464-4b9b16c9db65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Flow 'volume_create_manager' (7d62f36d-1a3b-4a84-89a9-70bf82ffe9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:37 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d04c8eef-4cf5-48e5-a534-f02ee331d829 tempest-GroupsTest-306875327 None] Created volume successfully. Apr 14 02:59:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f022abbe-a0a7-4b3c-8fa5-e78279f76e27 tempest-GroupsTest-306875327 None] Update group completed successfully. Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Flow 'volume_create_manager' (aebdf4bc-e06e-4c1c-8af4-4dfce3d9c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30629ec7-22fe-4749-8a56-c8bfea320df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30629ec7-22fe-4749-8a56-c8bfea320df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1141972034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b366930f-eb21-4e9f-b5ed-6e4be09a1729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95cac82ea544c8bc5b02b59aec8fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:39Z,use_quota=True,user_id='619c7e9ef30c448eaa6ce277f19cb73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d16b96e-29c9-4e6f-b26d-03332a0e12e4),volume_type_id=7d16b96e-29c9-4e6f-b26d-03332a0e12e4)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d62083-30c7-45ec-b13e-ce522ecea92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d62083-30c7-45ec-b13e-ce522ecea92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a79b85-d501-4cd3-a35f-20d1c4e5173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a79b85-d501-4cd3-a35f-20d1c4e5173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b366930f-eb21-4e9f-b5ed-6e4be09a1729', 'volume_name': 'volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2742a1dc-9745-4aa7-94a8-501b7c146f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2742a1dc-9745-4aa7-94a8-501b7c146f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087ee523-156f-4437-8df3-a7651723225c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:38 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Volume b366930f-eb21-4e9f-b5ed-6e4be09a1729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729', 'volume_size': 1} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1141972034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b366930f-eb21-4e9f-b5ed-6e4be09a1729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd95cac82ea544c8bc5b02b59aec8fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:39Z,use_quota=True,user_id='619c7e9ef30c448eaa6ce277f19cb73e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d16b96e-29c9-4e6f-b26d-03332a0e12e4),volume_type_id=7d16b96e-29c9-4e6f-b26d-03332a0e12e4)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Creating volume b366930f-eb21-4e9f-b5ed-6e4be09a1729 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:59:38 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:59:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:38 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 1073741824 Apr 14 02:59:38 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:39 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 1073741824" returned: 0 in 0.488s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:39 devstack sudo[84087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 Apr 14 02:59:39 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:40 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729" returned: 0 in 0.636s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:59:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:40 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-84c9dbbe-9ecc-44f2-b1d5-f7c7b7cf7697 tempest-GroupsTest-306875327 None] Update group completed successfully. Apr 14 02:59:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087ee523-156f-4437-8df3-a7651723225c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f016c9b1-79e6-4058-99ec-d57608a97045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:40 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Volume volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 (b366930f-eb21-4e9f-b5ed-6e4be09a1729): created successfully Apr 14 02:59:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f016c9b1-79e6-4058-99ec-d57608a97045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Flow 'volume_create_manager' (aebdf4bc-e06e-4c1c-8af4-4dfce3d9c803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:40 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-36cbfa37-b73b-4224-a70c-04826748e53b tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Created volume successfully. Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=114,cinder:UPDATE=117,cinder:INSERT=25,cinder:DELETE=7 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:UPDATE=108,cinder:SELECT=86,cinder:INSERT=22,cinder:DELETE=9 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Acquiring lock "cinder-quobyte-bbe212cc-cb6b-4f14-9722-c0f44703c92c" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Lock "cinder-quobyte-bbe212cc-cb6b-4f14-9722-c0f44703c92c" acquired by "delete_volume" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a705ae-e109-43a0-975f-c8e3384ce2cb]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:41 devstack sudo[84121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:41 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:41 devstack sudo[84120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c Apr 14 02:59:41 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:42 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c" returned: 0 in 0.722s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:42 devstack sudo[84127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c Apr 14 02:59:42 devstack sudo[84127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:42 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.859s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:42 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:42 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-548b67e7-fef1-4b5e-9e0b-840eb250d9e1 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Retype volume completed successfully. Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Acquiring lock "cinder-b366930f-eb21-4e9f-b5ed-6e4be09a1729-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "cinder-b366930f-eb21-4e9f-b5ed-6e4be09a1729-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Acquiring lock "cinder-quobyte-b366930f-eb21-4e9f-b5ed-6e4be09a1729" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "cinder-quobyte-b366930f-eb21-4e9f-b5ed-6e4be09a1729" acquired by "delete_volume" :: waited 0.021s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[96380ab7-0a42-44b4-badb-010634663c35]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:43 devstack sudo[84127]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bbe212cc-cb6b-4f14-9722-c0f44703c92c" returned: 0 in 1.027s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:43 devstack sudo[84130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 Apr 14 02:59:43 devstack sudo[84130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Lock "cinder-quobyte-bbe212cc-cb6b-4f14-9722-c0f44703c92c" released by "delete_volume" :: held 1.784s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Acquiring lock "cinder-quobyte-f58e4848-19be-4aa9-8190-894c2e63cecc" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Lock "cinder-quobyte-f58e4848-19be-4aa9-8190-894c2e63cecc" acquired by "delete_volume" :: waited 0.016s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e9d667-b567-4d88-bfeb-27fc5b9e5320]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:43 devstack sudo[84133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc Apr 14 02:59:43 devstack sudo[84133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:44 devstack sudo[84133]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc" returned: 0 in 0.760s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:44 devstack sudo[84147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc Apr 14 02:59:44 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:44 devstack sudo[84130]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729" returned: 0 in 1.107s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:44 devstack sudo[84149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729 Apr 14 02:59:44 devstack sudo[84149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:44 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f58e4848-19be-4aa9-8190-894c2e63cecc" returned: 0 in 0.580s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Lock "cinder-quobyte-f58e4848-19be-4aa9-8190-894c2e63cecc" released by "delete_volume" :: held 1.367s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Created reservations ['73eede33-a140-4fe8-9bf1-b10da5245d2e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:44 devstack cinder-volume[82473]: WARNING cinder.quota [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1652027748 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1652027748, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:59:44 devstack cinder-volume[82473]: WARNING cinder.quota [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1652027748 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1652027748, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Created reservations ['5e3681ff-dfae-4e4b-9e7e-3097c3386ede', 'faf44cc3-35c5-411f-a5c3-b1f90d9918d5', '84c14ef5-e0b4-4b18-aef3-c09b6cd6c776', '1bea76e5-6715-48f5-bd28-01ec0e5cb959'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:44 devstack sudo[84149]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b366930f-eb21-4e9f-b5ed-6e4be09a1729" returned: 0 in 0.555s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "cinder-quobyte-b366930f-eb21-4e9f-b5ed-6e4be09a1729" released by "delete_volume" :: held 1.708s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Created reservations ['5e435f60-70f3-426d-952e-4025272aca20', 'dfee94ac-30f7-4f47-8b37-c446b3a10ba9', '8454018f-0f5b-4480-87e6-da33c648fd2a', '5b85290d-19e6-45c7-9dfe-dece59eec900'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:45 devstack cinder-volume[82473]: WARNING cinder.quota [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:59:45 devstack cinder-volume[82473]: WARNING cinder.quota [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Created reservations ['fd29d9da-38bb-4c3a-bcab-2c043b1efc3d', 'ce94b287-b1c6-47e2-996a-96b6819b8a16', '9c7a96fc-0a1d-4453-9207-f4c3a5555a79', '14b70f4d-6547-4921-944a-af470ad4a3c4'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:45 devstack sudo[84155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:45 devstack sudo[84155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:45 devstack sudo[84158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:45 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:45 devstack sudo[84155]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.652s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:45 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-64855c33-da1f-49e9-bd60-267f422ade95 tempest-GroupsTest-306875327 None] Delete group completed successfully. Apr 14 02:59:45 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.710s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:45 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Deleted volume successfully. Apr 14 02:59:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcf482fb-1e43-4ed9-ab0b-7805a53cb578 tempest-VolumeRetypeWithoutMigrationTest-788836265 None] Lock "cinder-b366930f-eb21-4e9f-b5ed-6e4be09a1729-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Flow 'volume_create_manager' (62aee38e-193b-42fc-b54e-b28ef0f0204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899a0eb3-e7e9-4dec-8cfb-35b197dd59d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899a0eb3-e7e9-4dec-8cfb-35b197dd59d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-796208262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42519489-abf8-435b-909d-fdd866704654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8a1aca5acc42258155a9013645e601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:50Z,use_quota=True,user_id='611c1270b3024af2a02797e9e877ef4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67873517-e9c9-4ce4-9d5f-338e0b1492d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67873517-e9c9-4ce4-9d5f-338e0b1492d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a36e08-0c25-4107-a2ac-9e69bff40a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a36e08-0c25-4107-a2ac-9e69bff40a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42519489-abf8-435b-909d-fdd866704654', 'volume_name': 'volume-42519489-abf8-435b-909d-fdd866704654', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a916d84a-2e2d-422e-9689-428df6d2b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a916d84a-2e2d-422e-9689-428df6d2b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6922b0b-6465-4fb0-a9ab-c4ea31daafc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:49 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Volume 42519489-abf8-435b-909d-fdd866704654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42519489-abf8-435b-909d-fdd866704654', 'volume_size': 1} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-796208262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42519489-abf8-435b-909d-fdd866704654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e8a1aca5acc42258155a9013645e601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:50Z,use_quota=True,user_id='611c1270b3024af2a02797e9e877ef4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Creating volume 42519489-abf8-435b-909d-fdd866704654 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:59:49 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:59:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:49 devstack sudo[84187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 1073741824 Apr 14 02:59:49 devstack sudo[84187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5e72e198-495e-44ed-8fb0-a4a2020969b9 tempest-GroupsV314Test-350468401 None] Group tempest-GroupsV314Test-Group-878418541: creating Apr 14 02:59:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5e72e198-495e-44ed-8fb0-a4a2020969b9 tempest-GroupsV314Test-350468401 None] Group tempest-GroupsV314Test-Group-878418541: created successfully Apr 14 02:59:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5e72e198-495e-44ed-8fb0-a4a2020969b9 tempest-GroupsV314Test-350468401 None] Create group completed successfully. Apr 14 02:59:51 devstack sudo[84187]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 1073741824" returned: 0 in 1.291s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:51 devstack sudo[84205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 Apr 14 02:59:51 devstack sudo[84205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:51 devstack sudo[84205]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654" returned: 0 in 0.482s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6922b0b-6465-4fb0-a9ab-c4ea31daafc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42519489-abf8-435b-909d-fdd866704654', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed6dbce-db9e-4819-9a14-9a6d5ea8c1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:51 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Volume volume-42519489-abf8-435b-909d-fdd866704654 (42519489-abf8-435b-909d-fdd866704654): created successfully Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed6dbce-db9e-4819-9a14-9a6d5ea8c1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Flow 'volume_create_manager' (62aee38e-193b-42fc-b54e-b28ef0f0204f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-030e4613-aac9-41ef-8c89-f8147a97e3ab tempest-VolumesServicesTestJSON-1069040415 None] Created volume successfully. Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Acquiring lock "cinder-42519489-abf8-435b-909d-fdd866704654-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Lock "cinder-42519489-abf8-435b-909d-fdd866704654-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Acquiring lock "cinder-quobyte-42519489-abf8-435b-909d-fdd866704654" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Lock "cinder-quobyte-42519489-abf8-435b-909d-fdd866704654" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e6512-6e73-4b74-bb56-b7cdc8c899e1]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:52 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 Apr 14 02:59:52 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Flow 'volume_create_manager' (665b9b46-fe5b-4d31-a6a7-ef4e23e64db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddb92b9-e79f-4ea2-9a1b-b9cf20b23a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddb92b9-e79f-4ea2-9a1b-b9cf20b23a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T00:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1927282246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=538c327a-0abc-4d32-ac2f-3b4c356b7023,host='devstack@QuobyteHD#QuobyteHD',id=cf9940bf-7306-40e1-9132-08a277113ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db95f5a457449c5a742dc936cd4efed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:53Z,use_quota=True,user_id='7a383f305e204addaa77c9a356631b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ba27906-0c20-472f-97f0-2f7da4490d8d),volume_type_id=0ba27906-0c20-472f-97f0-2f7da4490d8d)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151f0cac-41cf-4d23-abe2-d4c16356db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151f0cac-41cf-4d23-abe2-d4c16356db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728d45a3-9c33-4d51-a1c4-102938f74e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728d45a3-9c33-4d51-a1c4-102938f74e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9940bf-7306-40e1-9132-08a277113ed8', 'volume_name': 'volume-cf9940bf-7306-40e1-9132-08a277113ed8', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c06492-701d-4429-a967-788ee7d6e037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c06492-701d-4429-a967-788ee7d6e037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e1e489-3bfb-4116-8200-929d1bcb39bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:52 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Volume cf9940bf-7306-40e1-9132-08a277113ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9940bf-7306-40e1-9132-08a277113ed8', 'volume_size': 1} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=538c327a-0abc-4d32-ac2f-3b4c356b7023,created_at=2026-04-14T00:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1927282246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=538c327a-0abc-4d32-ac2f-3b4c356b7023,host='devstack@QuobyteHD#QuobyteHD',id=cf9940bf-7306-40e1-9132-08a277113ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db95f5a457449c5a742dc936cd4efed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T00:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T00:59:53Z,use_quota=True,user_id='7a383f305e204addaa77c9a356631b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ba27906-0c20-472f-97f0-2f7da4490d8d),volume_type_id=0ba27906-0c20-472f-97f0-2f7da4490d8d)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Creating volume cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 02:59:52 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 02:59:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:52 devstack sudo[84260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 1073741824 Apr 14 02:59:52 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:53 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654" returned: 0 in 0.871s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:53 devstack sudo[84267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654 Apr 14 02:59:53 devstack sudo[84267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:53 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 1073741824" returned: 0 in 0.729s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:53 devstack sudo[84273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 Apr 14 02:59:53 devstack sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:53 devstack sudo[84267]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-42519489-abf8-435b-909d-fdd866704654" returned: 0 in 0.664s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Lock "cinder-quobyte-42519489-abf8-435b-909d-fdd866704654" released by "delete_volume" :: held 1.570s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Created reservations ['4271aed9-1820-4276-9f83-b4b64cdff987', '6bec6c4c-e91b-4325-b609-a6078d9abaab', '6fef5af4-46e2-41bb-b9aa-7991bdb1bf2b', '83bb3dd5-c6fa-46e0-b9ea-61db0817826e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 02:59:53 devstack sudo[84273]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8" returned: 0 in 0.481s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 02:59:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e1e489-3bfb-4116-8200-929d1bcb39bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9940bf-7306-40e1-9132-08a277113ed8', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca18413-2ff6-44fe-92a9-b44aa42d3ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 02:59:54 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Volume volume-cf9940bf-7306-40e1-9132-08a277113ed8 (cf9940bf-7306-40e1-9132-08a277113ed8): created successfully Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca18413-2ff6-44fe-92a9-b44aa42d3ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Flow 'volume_create_manager' (665b9b46-fe5b-4d31-a6a7-ef4e23e64db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:54 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-2bfea90f-447a-473e-9c85-50a968f95c78 tempest-GroupsV314Test-350468401 None] Created volume successfully. Apr 14 02:59:54 devstack sudo[84277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 02:59:54 devstack sudo[84277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:54 devstack sudo[84277]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.461s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 02:59:54 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Deleted volume successfully. Apr 14 02:59:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a81cc26e-127b-4ae7-a4b1-fddc518bd099 tempest-VolumesServicesTestJSON-1069040415 None] Lock "cinder-42519489-abf8-435b-909d-fdd866704654-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 02:59:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 02:59:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 02:59:55 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Cloning volume cf9940bf-7306-40e1-9132-08a277113ed8 to volume b162d178-d788-4bff-85f1-041844121966 Apr 14 02:59:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Creating offline snapshot b4235ff4-2aa0-4870-be8f-a9244794f252 of volume cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 02:59:55 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7635a54-978a-40ad-988c-82e1725fba47]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 02:59:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:55 devstack sudo[84280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 Apr 14 02:59:55 devstack sudo[84280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:56 devstack sudo[84280]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8" returned: 0 in 0.619s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:56 devstack sudo[84288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 1G Apr 14 02:59:56 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:56 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 1G" returned: 0 in 0.685s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9940bf-7306-40e1-9132-08a277113ed8 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:57 devstack sudo[84295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9940bf-7306-40e1-9132-08a277113ed8 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 Apr 14 02:59:57 devstack sudo[84295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:57 devstack sudo[84295]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf9940bf-7306-40e1-9132-08a277113ed8 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252" returned: 0 in 0.427s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:57 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 02:59:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:57 devstack sudo[84300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 Apr 14 02:59:57 devstack sudo[84300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:58 devstack sudo[84300]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252" returned: 0 in 1.068s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:58 devstack sudo[84329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.info Apr 14 02:59:58 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 02:59:59 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root Apr 14 02:59:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.info" returned: 0 in 1.221s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 02:59:59 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 02:59:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 02:59:59 devstack sudo[84333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.info Apr 14 02:59:59 devstack sudo[84333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:00 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Flow 'volume_create_manager' (8025d2e2-a539-4017-93fe-3faa613efb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398ec990-b810-4ede-9bd2-dacb6b806cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398ec990-b810-4ede-9bd2-dacb6b806cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:01Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39a46dd-4479-4154-9d66-a49f48705ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9aab2ad9f4cd2874b6e4681e55dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:01Z,use_quota=True,user_id='87d155729d614ff5b14eec77a174f417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:01 devstack sudo[84333]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e0763-9d09-43f2-b859-69678ab653f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e0763-9d09-43f2-b859-69678ab653f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6bc810-7e2a-4f73-bfab-09c140ed4850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.image.glance [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Creating Keystone auth plugin from conf {{(pid=82473) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.info" returned: 0 in 1.408s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Acquiring lock "cinder-quobyte-b162d178-d788-4bff-85f1-041844121966" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Lock "cinder-quobyte-b162d178-d788-4bff-85f1-041844121966" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] snapshot: b4235ff4-2aa0-4870-be8f-a9244794f252, volume: b162d178-d788-4bff-85f1-041844121966, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb22c8e7-57a5-4319-8f54-ee04ef647ffa]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:01 devstack sudo[84339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 Apr 14 03:00:01 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6bc810-7e2a-4f73-bfab-09c140ed4850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd39a46dd-4479-4154-9d66-a49f48705ee5', 'volume_name': 'volume-d39a46dd-4479-4154-9d66-a49f48705ee5', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71a7635-1239-4679-a0cb-afafb99ff474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71a7635-1239-4679-a0cb-afafb99ff474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7967de0-e42d-424a-8e4e-08fbb60ae8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:02 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Volume d39a46dd-4479-4154-9d66-a49f48705ee5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d39a46dd-4479-4154-9d66-a49f48705ee5', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Trying to clone d39a46dd-4479-4154-9d66-a49f48705ee5 from image 9179ce72-7062-46a0-b714-df74aac4cc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]). {{(pid=82473) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Flow 'volume_create_manager' (b2c9dbfc-4fdc-4f93-8715-83744c400eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a04240b-91a9-47cf-9399-0aca4b6435a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a04240b-91a9-47cf-9399-0aca4b6435a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-650856107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3780ee7-0e65-4612-9cb1-90ff4c649bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c0a1d6dfeb42639a049e9d9d7ee562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:02Z,use_quota=True,user_id='e2de4e33721d4bd6b75c32155db82bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65d9ea5-941a-4224-bb82-e36a8388a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65d9ea5-941a-4224-bb82-e36a8388a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcbe3d9-6a45-464e-981d-f306db4dac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcbe3d9-6a45-464e-981d-f306db4dac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3780ee7-0e65-4612-9cb1-90ff4c649bd7', 'volume_name': 'volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32de4795-c388-47ae-9a89-ef3626a05ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32de4795-c388-47ae-9a89-ef3626a05ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bb115a-f373-4f25-be71-e2eee7d90338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:02 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Volume b3780ee7-0e65-4612-9cb1-90ff4c649bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7', 'volume_size': 1} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 14 03:00:02 devstack cinder-volume[82473]: INFO cinder.image.image_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Image download 20.69 MB at 20.69 MB/s Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6885bb-d028-4986-b69b-07b62b9483ce]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:02 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252" returned: 0 in 1.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9940bf-7306-40e1-9132-08a277113ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[231ffec9-c1d6-4b8a-b555-b075736910b6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:03 devstack sudo[84399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD Apr 14 03:00:03 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:03 devstack sudo[84400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 Apr 14 03:00:03 devstack sudo[84400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:03 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:03 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Temporary image 9179ce72-7062-46a0-b714-df74aac4cc2c is fetched for user 87d155729d614ff5b14eec77a174f417. {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 14 03:00:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e077bc43-da8f-4bec-9b90-69c3647d4b5f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:03 devstack sudo[84409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD Apr 14 03:00:03 devstack sudo[84409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:03 devstack sudo[84400]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8" returned: 0 in 1.043s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:03 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:00:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:03 devstack sudo[84411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 Apr 14 03:00:03 devstack sudo[84411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:04 devstack sudo[84409]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD" returned: 0 in 0.865s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:08 devstack sudo[84411]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966" returned: 0 in 4.234s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:08 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e795cd-ca1f-4144-8626-e8f3b9dc77bc]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:08 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 Apr 14 03:00:08 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:08 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8" returned: 0 in 0.728s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:08 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:00:08 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Converted 1024.00 MB image at 241.71 MB/s Apr 14 03:00:08 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:00:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:08 devstack sudo[84448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 Apr 14 03:00:08 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Flow 'volume_create_manager' (b280aac2-23fe-4f6f-b817-9c7a1027eab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa1d66b-f1e7-489f-abfa-41c821b6b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa1d66b-f1e7-489f-abfa-41c821b6b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1467190658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f81a1b-a139-417a-8364-c216129b9a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da13e08cfe464dc8be2b09b72884ab02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:09Z,use_quota=True,user_id='6f256168cef84640b48db6f1b5f74f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40bc439-af54-4413-a085-6ba00d0075b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40bc439-af54-4413-a085-6ba00d0075b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e805a9c8-d16f-418a-a7cc-cecef056ba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e805a9c8-d16f-418a-a7cc-cecef056ba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f81a1b-a139-417a-8364-c216129b9a3f', 'volume_name': 'volume-c6f81a1b-a139-417a-8364-c216129b9a3f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015cac12-6093-41f2-92b6-7a7bc634d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015cac12-6093-41f2-92b6-7a7bc634d73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58fb64f-ba5c-46f2-b102-a832f97f52de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:09 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Volume c6f81a1b-a139-417a-8364-c216129b9a3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f81a1b-a139-417a-8364-c216129b9a3f', 'volume_size': 1} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:09 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966" returned: 0 in 0.601s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Lock "cinder-quobyte-b162d178-d788-4bff-85f1-041844121966" released by "_copy_volume_from_snapshot" :: held 8.262s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Acquiring lock "cinder-quobyte-b4235ff4-2aa0-4870-be8f-a9244794f252" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Lock "cinder-quobyte-b4235ff4-2aa0-4870-be8f-a9244794f252" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Deleting offline snapshot b4235ff4-2aa0-4870-be8f-a9244794f252 of volume cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] snapshot_file for this snap is: volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01f50f8-69a8-45c1-ab29-6ff4ac37432f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:09 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 Apr 14 03:00:09 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:09 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252" returned: 0 in 0.476s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf9940bf-7306-40e1-9132-08a277113ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:00:10 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6013c6d1-dc87-4191-a52a-0298d0b79150]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:10 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 Apr 14 03:00:10 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:10 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8" returned: 0 in 0.553s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:10 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 Apr 14 03:00:10 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:11 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252" returned: 0 in 0.454s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:11 devstack sudo[84466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252 Apr 14 03:00:11 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:11 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8.b4235ff4-2aa0-4870-be8f-a9244794f252" returned: 0 in 0.476s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Lock "cinder-quobyte-b4235ff4-2aa0-4870-be8f-a9244794f252" released by "_delete_snapshot" :: held 2.011s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.931s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.014s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-650856107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3780ee7-0e65-4612-9cb1-90ff4c649bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c0a1d6dfeb42639a049e9d9d7ee562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:02Z,use_quota=True,user_id='e2de4e33721d4bd6b75c32155db82bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Creating volume b3780ee7-0e65-4612-9cb1-90ff4c649bd7 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:00:11 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:00:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:11 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 1073741824 Apr 14 03:00:11 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:11 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-abb04917-2891-4261-93b4-48ed26a4a5e4 tempest-GroupsV314Test-350468401 None] Create group from source-group-538c327a-0abc-4d32-ac2f-3b4c356b7023 completed successfully. Apr 14 03:00:12 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 1073741824" returned: 0 in 0.559s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:12 devstack sudo[84474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 Apr 14 03:00:12 devstack sudo[84474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:12 devstack sudo[84474]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7" returned: 0 in 0.459s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.990s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:01Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39a46dd-4479-4154-9d66-a49f48705ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fee9aab2ad9f4cd2874b6e4681e55dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:01Z,use_quota=True,user_id='87d155729d614ff5b14eec77a174f417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Creating volume d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:00:12 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bb115a-f373-4f25-be71-e2eee7d90338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff3ae32-3d7b-4ddb-85f9-49a72c69a27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:12 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Volume volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 (b3780ee7-0e65-4612-9cb1-90ff4c649bd7): created successfully Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff3ae32-3d7b-4ddb-85f9-49a72c69a27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:12 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 1073741824 Apr 14 03:00:12 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Flow 'volume_create_manager' (b2c9dbfc-4fdc-4f93-8715-83744c400eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:12 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8218d95d-e952-4a80-8059-33a0dedb8659 tempest-DeleteServersTestJSON-1490699324 None] Created volume successfully. Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Acquiring lock "cinder-quobyte-b162d178-d788-4bff-85f1-041844121966" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Lock "cinder-quobyte-b162d178-d788-4bff-85f1-041844121966" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aba4ce-52c0-43b2-a2fa-c302845316ac]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:12 devstack sudo[84479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 Apr 14 03:00:12 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:13 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 1073741824" returned: 0 in 0.632s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:13 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966" returned: 0 in 0.511s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:13 devstack sudo[84487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:00:13 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:13 devstack sudo[84489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966 Apr 14 03:00:13 devstack sudo[84489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:13 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 0 in 0.586s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.555s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1467190658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f81a1b-a139-417a-8364-c216129b9a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da13e08cfe464dc8be2b09b72884ab02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:09Z,use_quota=True,user_id='6f256168cef84640b48db6f1b5f74f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Creating volume c6f81a1b-a139-417a-8364-c216129b9a3f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:00:13 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:13 devstack sudo[84489]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b162d178-d788-4bff-85f1-041844121966" returned: 0 in 0.612s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:13 devstack sudo[84494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f 1073741824 Apr 14 03:00:13 devstack sudo[84494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Attempting download of 9179ce72-7062-46a0-b714-df74aac4cc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}])) to volume d39a46dd-4479-4154-9d66-a49f48705ee5. {{(pid=82473) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Lock "cinder-quobyte-b162d178-d788-4bff-85f1-041844121966" released by "delete_volume" :: held 1.149s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6cb16f-02df-486a-b590-aea47bc19ca2]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c__xqp4n01 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:13 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Created reservations ['e9450944-e73f-4f15-aa96-e8ddfc5afd27'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:14 devstack cinder-volume[82473]: WARNING cinder.quota [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2025133160 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2025133160, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:00:14 devstack cinder-volume[82473]: WARNING cinder.quota [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2025133160 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2025133160, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:00:14 devstack sudo[84496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c__xqp4n01 Apr 14 03:00:14 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Created reservations ['06aa5540-3a0f-453d-acfb-36adda00a718', '697eea58-32fc-4d99-80de-7d5368b27506', 'f615a87b-8d3d-4a4f-903b-2dd761e9dbfd', 'f00e8b6f-38e2-46ba-adba-63a9add75bb0'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:14 devstack sudo[84498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:14 devstack sudo[84498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:14 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c__xqp4n01" returned: 0 in 0.657s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c__xqp4n01 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:14 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:14 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:14 devstack sudo[84505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c__xqp4n01 Apr 14 03:00:14 devstack sudo[84505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:14 devstack sudo[84498]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.709s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:14 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:14 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-68251d92-27f1-4670-abfc-5c57222e8e9b tempest-GroupsV314Test-350468401 None] Delete group completed successfully. Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f 1073741824" returned: 0 in 1.162s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:15 devstack sudo[84494]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:15 devstack sudo[84510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f Apr 14 03:00:15 devstack sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Acquiring lock "cinder-quobyte-cf9940bf-7306-40e1-9132-08a277113ed8" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Lock "cinder-quobyte-cf9940bf-7306-40e1-9132-08a277113ed8" acquired by "delete_volume" :: waited 0.023s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:15 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.688s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[464bbb3b-c279-4283-aadd-7fbf98ec1c64]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:15 devstack sudo[84513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 Apr 14 03:00:15 devstack sudo[84513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:15 devstack sudo[84505]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c__xqp4n01" returned: 1 in 0.877s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c__xqp4n01' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba1a50-f228-4288-829e-73f5c990cd86]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:15 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD Apr 14 03:00:15 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:15 devstack sudo[84510]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f" returned: 0 in 0.587s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58fb64f-ba5c-46f2-b102-a832f97f52de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f81a1b-a139-417a-8364-c216129b9a3f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e33bf07-c258-41a9-876e-dfdd8b273e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:15 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Volume volume-c6f81a1b-a139-417a-8364-c216129b9a3f (c6f81a1b-a139-417a-8364-c216129b9a3f): created successfully Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e33bf07-c258-41a9-876e-dfdd8b273e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Flow 'volume_create_manager' (b280aac2-23fe-4f6f-b817-9c7a1027eab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:15 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-dc3448fd-cd90-4f4e-b43c-0f37cab3ce9f tempest-AbsoluteLimitsTests-259502909 None] Created volume successfully. Apr 14 03:00:15 devstack sudo[84513]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8" returned: 0 in 0.666s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:16 devstack sudo[84523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8 Apr 14 03:00:16 devstack sudo[84523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:16 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD" returned: 0 in 0.683s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] 9179ce72-7062-46a0-b714-df74aac4cc2c was qcow2, converting to raw {{(pid=82473) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:16 devstack sudo[84528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:00:16 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:16 devstack sudo[84523]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-cf9940bf-7306-40e1-9132-08a277113ed8" returned: 0 in 0.450s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Lock "cinder-quobyte-cf9940bf-7306-40e1-9132-08a277113ed8" released by "delete_volume" :: held 1.172s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Created reservations ['3ead5fa7-9a19-4749-b8a0-badc91f3acf9'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Created reservations ['edbbff26-a909-4840-a078-43fcca3551f6', '766d2021-f468-44e0-bf60-4827f0698b05', '97f93dbb-8a89-426b-ac67-afc4cef34081', 'eb3541ae-dc44-4529-9204-83cc66b9c7ff'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:16 devstack sudo[84545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:16 devstack sudo[84545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-02677a72-0dbc-4853-9a0e-8fb6cca7dc8c req-96198e11-e22f-4927-b931-18badf6d25db tempest-DeleteServersTestJSON-1490699324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-02677a72-0dbc-4853-9a0e-8fb6cca7dc8c req-96198e11-e22f-4927-b931-18badf6d25db tempest-DeleteServersTestJSON-1490699324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d22bf0-cdf7-490c-bcff-4d597877d999]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-02677a72-0dbc-4853-9a0e-8fb6cca7dc8c req-96198e11-e22f-4927-b931-18badf6d25db tempest-DeleteServersTestJSON-1490699324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Acquiring lock "cinder-c6f81a1b-a139-417a-8364-c216129b9a3f-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Lock "cinder-c6f81a1b-a139-417a-8364-c216129b9a3f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Acquiring lock "cinder-quobyte-c6f81a1b-a139-417a-8364-c216129b9a3f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Lock "cinder-quobyte-c6f81a1b-a139-417a-8364-c216129b9a3f" acquired by "delete_volume" :: waited 0.017s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[175a5e13-3728-4ae2-a346-b10b6db6d864]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:17 devstack sudo[84547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 Apr 14 03:00:17 devstack sudo[84547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:17 devstack sudo[84548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f Apr 14 03:00:17 devstack sudo[84548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:17 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 0 in 1.093s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vwkvofdldevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:00:17 devstack cinder-volume[82473]: INFO cinder.image.image_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Converted 112.00 MB image at 102.32 MB/s Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:17 devstack sudo[84551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 1G Apr 14 03:00:17 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:17 devstack sudo[84545]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.931s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:17 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-939703e4-1ab6-4baf-b46d-820c3cb561e2 tempest-GroupsV314Test-350468401 None] Delete group completed successfully. Apr 14 03:00:17 devstack sudo[84547]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-02677a72-0dbc-4853-9a0e-8fb6cca7dc8c req-96198e11-e22f-4927-b931-18badf6d25db tempest-DeleteServersTestJSON-1490699324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7" returned: 0 in 1.048s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-02677a72-0dbc-4853-9a0e-8fb6cca7dc8c req-96198e11-e22f-4927-b931-18badf6d25db tempest-DeleteServersTestJSON-1490699324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.061s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:17 devstack sudo[84548]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f" returned: 0 in 0.919s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:17 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 1G" returned: 0 in 0.658s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:17 devstack sudo[84563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f Apr 14 03:00:17 devstack sudo[84563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee924870-5c46-4305-927c-af2095f468e9]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-02677a72-0dbc-4853-9a0e-8fb6cca7dc8c req-96198e11-e22f-4927-b931-18badf6d25db tempest-DeleteServersTestJSON-1490699324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c', 'name': 'volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d30b12b-ed48-4eef-bbf1-0bfff1ed7933', 'enforce_multipath': True} {{(pid=82473) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 14 03:00:18 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-02677a72-0dbc-4853-9a0e-8fb6cca7dc8c req-96198e11-e22f-4927-b931-18badf6d25db tempest-DeleteServersTestJSON-1490699324 None] attachment_update completed successfully. Apr 14 03:00:18 devstack sudo[84565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:00:18 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:18 devstack sudo[84563]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c6f81a1b-a139-417a-8364-c216129b9a3f" returned: 0 in 0.592s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Lock "cinder-quobyte-c6f81a1b-a139-417a-8364-c216129b9a3f" released by "delete_volume" :: held 1.541s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Created reservations ['e214bc30-ea71-4d3f-bf71-9e887c9cd7e4', '6c7ec57e-ece1-4e24-a8d1-1b6ff06f16c2', 'f4bb6ccd-8f21-43c3-a262-e3b73d9d79d4', '3f06e89e-ce1b-4068-abea-693a130b1071'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:18 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 0 in 0.717s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:18 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:18 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:18 devstack sudo[84571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:00:18 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:19 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 1 in 0.609s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Downloaded image 9179ce72-7062-46a0-b714-df74aac4cc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}])) to volume d39a46dd-4479-4154-9d66-a49f48705ee5 successfully. {{(pid=82473) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Temporary image 9179ce72-7062-46a0-b714-df74aac4cc2c for user 87d155729d614ff5b14eec77a174f417 is deleted. {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Marking volume d39a46dd-4479-4154-9d66-a49f48705ee5 as bootable. {{(pid=82473) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Copying metadata from image 9179ce72-7062-46a0-b714-df74aac4cc2c to d39a46dd-4479-4154-9d66-a49f48705ee5. {{(pid=82473) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Creating volume glance metadata for volume d39a46dd-4479-4154-9d66-a49f48705ee5 backed by image 9179ce72-7062-46a0-b714-df74aac4cc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82473) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 14 03:00:19 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.647s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:19 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Deleted volume successfully. Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b223785d-210d-4278-b7e8-b166805e832f tempest-AbsoluteLimitsTests-259502909 None] Lock "cinder-c6f81a1b-a139-417a-8364-c216129b9a3f-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7967de0-e42d-424a-8e4e-08fbb60ae8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39a46dd-4479-4154-9d66-a49f48705ee5', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c7539b-b5ca-49ca-a2c0-914bc68e0dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:19 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Volume volume-d39a46dd-4479-4154-9d66-a49f48705ee5 (d39a46dd-4479-4154-9d66-a49f48705ee5): created successfully Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c7539b-b5ca-49ca-a2c0-914bc68e0dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Flow 'volume_create_manager' (8025d2e2-a539-4017-93fe-3faa613efb47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:19 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-0cb0d976-d415-4872-b112-f317b7bb7cf7 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Created volume successfully. Apr 14 03:00:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a5b7fd-18f2-49c4-998c-d74d2f9d2704]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:20 devstack sudo[84590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:00:20 devstack sudo[84590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:20 devstack sudo[84590]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 0 in 0.725s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:20 devstack sudo[84594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:00:20 devstack sudo[84594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:21 devstack sudo[84594]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 1 in 0.640s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:00:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.403s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c', 'name': 'volume-d39a46dd-4479-4154-9d66-a49f48705ee5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aac6b14d-c373-4062-b09c-ae0010d68ea5', 'enforce_multipath': True} {{(pid=82473) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 14 03:00:21 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-a0800687-03ba-4ed4-8564-242c582e78d8 req-bc91ea49-92a0-4bf8-9124-06a235dd1ca2 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] attachment_update completed successfully. Apr 14 03:00:21 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d59804ad-0ec2-44d6-b58c-912dda6726c6 tempest-GroupsV320Test-75224624 None] Group tempest-GroupsV320Test-Group-114352848: creating Apr 14 03:00:21 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d59804ad-0ec2-44d6-b58c-912dda6726c6 tempest-GroupsV320Test-75224624 None] Group tempest-GroupsV320Test-Group-114352848: created successfully Apr 14 03:00:21 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d59804ad-0ec2-44d6-b58c-912dda6726c6 tempest-GroupsV320Test-75224624 None] Create group completed successfully. Apr 14 03:00:23 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Created reservations ['4500c5b2-a528-482d-94f8-51f593908bbe'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:23 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:23 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Flow 'volume_create_manager' (2dbd3b10-0834-4c18-b25a-80e5445276a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bb4175-703c-472f-a2e2-d828976aa7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bb4175-703c-472f-a2e2-d828976aa7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-114682024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6575e23-55e3-4fbe-a64e-30ff6ed74ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7058d29a60e34bf0b78e16911c4a0793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:24Z,use_quota=True,user_id='e91ccd72c62b44bfb505cb697f3b26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1717a62-bbad-4ee3-9d52-907f63b27b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1717a62-bbad-4ee3-9d52-907f63b27b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbba2e2-4734-4e8f-b3c4-b89f61822b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbba2e2-4734-4e8f-b3c4-b89f61822b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6575e23-55e3-4fbe-a64e-30ff6ed74ab4', 'volume_name': 'volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bacc59-4e7b-43d2-b2d1-40fb045e21cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bacc59-4e7b-43d2-b2d1-40fb045e21cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0370a930-24e5-41e8-85fe-3a44f71a805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:24 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Volume a6575e23-55e3-4fbe-a64e-30ff6ed74ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4', 'volume_size': 1} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-114682024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6575e23-55e3-4fbe-a64e-30ff6ed74ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7058d29a60e34bf0b78e16911c4a0793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:24Z,use_quota=True,user_id='e91ccd72c62b44bfb505cb697f3b26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Creating volume a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:00:24 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:24 devstack sudo[84612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 1073741824 Apr 14 03:00:24 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:24 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.590s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-59a40e86-d5e8-4d9f-99f4-436fe767a6aa tempest-GroupsV320Test-75224624 None] Delete group completed successfully. Apr 14 03:00:24 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 1073741824" returned: 0 in 0.748s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:24 devstack sudo[84647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 Apr 14 03:00:24 devstack sudo[84647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:25 devstack sudo[84647]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4" returned: 0 in 0.528s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:00:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0370a930-24e5-41e8-85fe-3a44f71a805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69eb731-e22a-4d71-bbcd-24d8f0df599b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:25 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Volume volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 (a6575e23-55e3-4fbe-a64e-30ff6ed74ab4): created successfully Apr 14 03:00:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69eb731-e22a-4d71-bbcd-24d8f0df599b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Flow 'volume_create_manager' (2dbd3b10-0834-4c18-b25a-80e5445276a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:25 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e46e9525-2d84-4ddc-b037-46cf45febdd3 tempest-VolumesTransfersV355Test-1201791655 None] Created volume successfully. Apr 14 03:00:26 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-59cb1381-c314-4ba3-ae59-5fb45fa2f1fc tempest-VolumesTransfersV355Test-588047176 None] Transfer volume completed successfully. Apr 14 03:00:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-95dc46cf-ff7e-4ab3-89f7-95af5a387c82 req-c2db0d35-1a69-42b7-9a21-4c0b5984dd53 tempest-DeleteServersTestJSON-1490699324 None] Terminate volume connection completed successfully. Apr 14 03:00:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-95dc46cf-ff7e-4ab3-89f7-95af5a387c82 req-c2db0d35-1a69-42b7-9a21-4c0b5984dd53 tempest-DeleteServersTestJSON-1490699324 None] Deleting attachment 9d30b12b-ed48-4eef-bbf1-0bfff1ed7933. {{(pid=82473) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 14 03:00:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Acquiring lock "cinder-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Lock "cinder-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Acquiring lock "cinder-quobyte-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Lock "cinder-quobyte-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:27 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4260cdb9-d939-4da3-ab1d-8b41e324122e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:27 devstack sudo[84686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 Apr 14 03:00:27 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:28 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4" returned: 0 in 0.628s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:28 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4 Apr 14 03:00:28 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:29 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4" returned: 0 in 0.654s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Lock "cinder-quobyte-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4" released by "delete_volume" :: held 1.312s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Created reservations ['899b8c3e-4e99-45a3-ad8c-f608be813d9c', 'edbe12cc-3fc6-4709-8fdb-394a9d83b84c', 'aa47ad3c-eb96-49ea-af24-b91a09d10c12', '1a4f36b7-c57a-4a03-a957-d8d04ece5094'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:29 devstack sudo[84694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:29 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:29 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.584s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:29 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Deleted volume successfully. Apr 14 03:00:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e42cb264-b264-4e7e-8bc8-94d43382db1e tempest-VolumesTransfersV355Test-1264133000 None] Lock "cinder-a6575e23-55e3-4fbe-a64e-30ff6ed74ab4-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Flow 'volume_create_manager' (21382827-0106-4db0-9d71-a79dd17128f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333819e7-07e5-4996-a5c6-7afefdad3f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333819e7-07e5-4996-a5c6-7afefdad3f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1359210926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0aab43-bdd4-4fed-a442-199f2555e919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7058d29a60e34bf0b78e16911c4a0793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:30Z,use_quota=True,user_id='e91ccd72c62b44bfb505cb697f3b26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2843ecf6-5764-44f7-8e58-0ab07429d8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2843ecf6-5764-44f7-8e58-0ab07429d8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4657a6ed-64b9-4a08-9f53-6fa763eae889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4657a6ed-64b9-4a08-9f53-6fa763eae889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0aab43-bdd4-4fed-a442-199f2555e919', 'volume_name': 'volume-0b0aab43-bdd4-4fed-a442-199f2555e919', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3145a1-e088-4888-9b76-3be4475ae2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3145a1-e088-4888-9b76-3be4475ae2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9376fd-0371-45db-93b4-a12b51d05a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:30 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Volume 0b0aab43-bdd4-4fed-a442-199f2555e919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0aab43-bdd4-4fed-a442-199f2555e919', 'volume_size': 1} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1359210926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0aab43-bdd4-4fed-a442-199f2555e919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7058d29a60e34bf0b78e16911c4a0793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:30Z,use_quota=True,user_id='e91ccd72c62b44bfb505cb697f3b26b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Creating volume 0b0aab43-bdd4-4fed-a442-199f2555e919 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:00:30 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:30 devstack sudo[84697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 1073741824 Apr 14 03:00:30 devstack sudo[84697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Acquiring lock "cinder-b3780ee7-0e65-4612-9cb1-90ff4c649bd7-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Lock "cinder-b3780ee7-0e65-4612-9cb1-90ff4c649bd7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Acquiring lock "cinder-quobyte-b3780ee7-0e65-4612-9cb1-90ff4c649bd7" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Lock "cinder-quobyte-b3780ee7-0e65-4612-9cb1-90ff4c649bd7" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b71e6a1-b4ba-4f3b-9629-e1c65e0f749a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:31 devstack sudo[84702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 Apr 14 03:00:31 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:31 devstack sudo[84697]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 1073741824" returned: 0 in 0.735s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:31 devstack sudo[84704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 Apr 14 03:00:31 devstack sudo[84704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:31 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7" returned: 0 in 0.663s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:31 devstack sudo[84710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7 Apr 14 03:00:31 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:31 devstack sudo[84704]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919" returned: 0 in 0.533s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9376fd-0371-45db-93b4-a12b51d05a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0aab43-bdd4-4fed-a442-199f2555e919', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5159b9-1ebd-4a93-9b2c-ede7f4e572b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Volume volume-0b0aab43-bdd4-4fed-a442-199f2555e919 (0b0aab43-bdd4-4fed-a442-199f2555e919): created successfully Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5159b9-1ebd-4a93-9b2c-ede7f4e572b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Flow 'volume_create_manager' (21382827-0106-4db0-9d71-a79dd17128f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6b61e7fa-d82c-43e6-ad1f-15dbb35914b2 tempest-VolumesTransfersV355Test-1201791655 None] Created volume successfully. Apr 14 03:00:32 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b3780ee7-0e65-4612-9cb1-90ff4c649bd7" returned: 0 in 0.549s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Lock "cinder-quobyte-b3780ee7-0e65-4612-9cb1-90ff4c649bd7" released by "delete_volume" :: held 1.244s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Created reservations ['752bb28b-c3e6-43dd-a477-ac868f5f6238', 'b740a455-a006-48b5-b1df-7bd5399e63b5', '1d939edc-a9df-4a56-8d44-372a6a35638b', '5e64f1bf-26c6-4a72-aa66-8a36bbf7723f'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:32 devstack sudo[84713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:32 devstack sudo[84713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Acquiring lock "cinder-0b0aab43-bdd4-4fed-a442-199f2555e919-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Lock "cinder-0b0aab43-bdd4-4fed-a442-199f2555e919-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Acquiring lock "cinder-quobyte-0b0aab43-bdd4-4fed-a442-199f2555e919" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Lock "cinder-quobyte-0b0aab43-bdd4-4fed-a442-199f2555e919" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1042d1-c1f6-44df-b760-899d0cc49d7e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:32 devstack sudo[84715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 Apr 14 03:00:32 devstack sudo[84715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:33 devstack sudo[84713]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.636s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:33 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:33 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Deleted volume successfully. Apr 14 03:00:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d49d9bff-857d-405c-9665-d170a046feca tempest-DeleteServersTestJSON-1490699324 None] Lock "cinder-b3780ee7-0e65-4612-9cb1-90ff4c649bd7-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:33 devstack sudo[84715]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919" returned: 0 in 0.654s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:33 devstack sudo[84721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919 Apr 14 03:00:33 devstack sudo[84721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:34 devstack sudo[84721]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0b0aab43-bdd4-4fed-a442-199f2555e919" returned: 0 in 0.747s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Lock "cinder-quobyte-0b0aab43-bdd4-4fed-a442-199f2555e919" released by "delete_volume" :: held 1.434s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Created reservations ['3955f5fa-9556-42f7-90c9-18aad678c672', '78022180-d1b2-4665-91f6-18a6170f3a0f', '3ac3511c-f128-49db-bf83-6d6c5d6fdc6f', '7530ffe1-d9fa-4cc5-828f-b36af8c8e64c'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:34 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:34 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:34 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.601s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:34 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:34 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Deleted volume successfully. Apr 14 03:00:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-588f1085-9fab-4ad0-9ce2-49aed9ded474 tempest-VolumesTransfersV355Test-1264133000 None] Lock "cinder-0b0aab43-bdd4-4fed-a442-199f2555e919-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:39 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:00:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Flow 'volume_create_manager' (a7852510-f35b-4ef9-82ca-4d0c0c79660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095c44d5-b6a9-4fe4-8b5e-7b5e462068ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095c44d5-b6a9-4fe4-8b5e-7b5e462068ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1156544430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d8d68f-b52f-4106-9ea4-c066f02784d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99371b7878374b9f917b24d8d940ecf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:40Z,use_quota=True,user_id='fa0b721c9fcf4215a2eee8f7eab447e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8ec1c0-7819-47f6-b5d9-09bfa58905a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8ec1c0-7819-47f6-b5d9-09bfa58905a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d99b91-d2b1-43c0-ad38-d414baf594b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:39 devstack cinder-volume[82473]: DEBUG cinder.image.glance [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Creating Keystone auth plugin from conf {{(pid=82473) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 14 03:00:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d99b91-d2b1-43c0-ad38-d414baf594b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7d8d68f-b52f-4106-9ea4-c066f02784d6', 'volume_name': 'volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3ea7a0-59f2-4a42-9fad-bc696aeda320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3ea7a0-59f2-4a42-9fad-bc696aeda320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784937cb-dffd-4515-9c8c-a46b36c9e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:40 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Volume b7d8d68f-b52f-4106-9ea4-c066f02784d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:00:40 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Trying to clone b7d8d68f-b52f-4106-9ea4-c066f02784d6 from image 9179ce72-7062-46a0-b714-df74aac4cc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]). {{(pid=82473) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 14 03:00:40 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 14 03:00:40 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Image download 20.69 MB at 20.69 MB/s Apr 14 03:00:40 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d8831a-5e78-45df-a1cc-eb57c7a309f3]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:40 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD Apr 14 03:00:40 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:41 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD" returned: 0 in 0.724s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:41 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Temporary image 9179ce72-7062-46a0-b714-df74aac4cc2c is fetched for user fa0b721c9fcf4215a2eee8f7eab447e5. {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 14 03:00:41 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f747ea1-ecaf-4b58-8e33-1943bbe52450]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:41 devstack sudo[84804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD Apr 14 03:00:41 devstack sudo[84804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:42 devstack sudo[84804]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD" returned: 0 in 0.933s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1156544430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d8d68f-b52f-4106-9ea4-c066f02784d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99371b7878374b9f917b24d8d940ecf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:40Z,use_quota=True,user_id='fa0b721c9fcf4215a2eee8f7eab447e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Creating volume b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:00:42 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:42 devstack sudo[84810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 1073741824 Apr 14 03:00:42 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:42 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 1073741824" returned: 0 in 0.763s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:UPDATE=144,cinder:SELECT=112,cinder:INSERT=30,cinder:DELETE=7 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=129,cinder:UPDATE=111,cinder:INSERT=37,cinder:DELETE=6 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:00:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:42 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:42 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:43 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 0 in 0.528s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:00:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:43 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Attempting download of 9179ce72-7062-46a0-b714-df74aac4cc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}])) to volume b7d8d68f-b52f-4106-9ea4-c066f02784d6. {{(pid=82473) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 14 03:00:43 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2ff2d1-3c97-4a49-8172-e635f860cada]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_usv8rgll {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:43 devstack sudo[84819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_usv8rgll Apr 14 03:00:43 devstack sudo[84819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:44 devstack sudo[84819]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_usv8rgll" returned: 0 in 0.635s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_usv8rgll {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:44 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_usv8rgll Apr 14 03:00:44 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:44 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_usv8rgll" returned: 1 in 0.576s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_usv8rgll' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:00:44 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[369302a3-bbb4-487d-b937-cccb456cecc7]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:44 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD Apr 14 03:00:44 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:45 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD" returned: 0 in 0.665s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:45 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] 9179ce72-7062-46a0-b714-df74aac4cc2c was qcow2, converting to raw {{(pid=82473) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 14 03:00:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:45 devstack sudo[84838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:45 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:46 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 0 in 1.263s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:46 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_z75jg8s5devstack@QuobyteHD, size 112.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:00:46 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Converted 112.00 MB image at 88.59 MB/s Apr 14 03:00:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:46 devstack sudo[84855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 1G Apr 14 03:00:46 devstack sudo[84855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:47 devstack sudo[84855]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 1G" returned: 0 in 0.664s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:47 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a525d8-fa01-4b02-b60c-444ac38a4ff0]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:47 devstack sudo[84860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:47 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:48 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 0 in 0.741s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:48 devstack sudo[84864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:48 devstack sudo[84864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:48 devstack sudo[84864]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 1 in 0.846s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Downloaded image 9179ce72-7062-46a0-b714-df74aac4cc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}])) to volume b7d8d68f-b52f-4106-9ea4-c066f02784d6 successfully. {{(pid=82473) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Temporary image 9179ce72-7062-46a0-b714-df74aac4cc2c for user fa0b721c9fcf4215a2eee8f7eab447e5 is deleted. {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Marking volume b7d8d68f-b52f-4106-9ea4-c066f02784d6 as bootable. {{(pid=82473) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Copying metadata from image 9179ce72-7062-46a0-b714-df74aac4cc2c to b7d8d68f-b52f-4106-9ea4-c066f02784d6. {{(pid=82473) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 14 03:00:48 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Creating volume glance metadata for volume b7d8d68f-b52f-4106-9ea4-c066f02784d6 backed by image 9179ce72-7062-46a0-b714-df74aac4cc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82473) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 14 03:00:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784937cb-dffd-4515-9c8c-a46b36c9e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97194e76-4646-4496-ba68-949487cffcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:49 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Volume volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 (b7d8d68f-b52f-4106-9ea4-c066f02784d6): created successfully Apr 14 03:00:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97194e76-4646-4496-ba68-949487cffcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Flow 'volume_create_manager' (a7852510-f35b-4ef9-82ca-4d0c0c79660f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:49 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3175fdc3-021a-4781-9094-b63f4b27bb0c tempest-VolumesExtendTest-992203246 None] Created volume successfully. Apr 14 03:00:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:49 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f9b54-724b-48d6-a6d0-9219fcffaea7]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:49 devstack sudo[84869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:49 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:50 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 0 in 0.783s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:50 devstack sudo[84876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:50 devstack sudo[84876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:51 devstack sudo[84876]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 1 in 0.706s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:00:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 2G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 2G" returned: 0 in 0.066s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.607s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-899fd8ab-af5a-483a-a1d4-b0d4b1a259af tempest-VolumesExtendTest-992203246 None] Extend volume completed successfully. Apr 14 03:00:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Acquiring lock "cinder-b7d8d68f-b52f-4106-9ea4-c066f02784d6-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Lock "cinder-b7d8d68f-b52f-4106-9ea4-c066f02784d6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Acquiring lock "cinder-quobyte-b7d8d68f-b52f-4106-9ea4-c066f02784d6" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:00:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Lock "cinder-quobyte-b7d8d68f-b52f-4106-9ea4-c066f02784d6" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:00:52 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dea8876-dc2a-48a4-aaa4-5f2d438b7ddb]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:52 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:52 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:53 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 0 in 0.899s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:53 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:53 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:53 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 1 in 0.706s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:00:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:53 devstack sudo[84975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6 Apr 14 03:00:53 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:54 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7d8d68f-b52f-4106-9ea4-c066f02784d6" returned: 0 in 0.534s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Lock "cinder-quobyte-b7d8d68f-b52f-4106-9ea4-c066f02784d6" released by "delete_volume" :: held 2.208s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Created reservations ['84b87fc5-9df5-49fe-9d3b-5ec3e531625b', 'd126143e-d7c3-469f-a51f-b357f85df76f', 'fc89c5ce-06e8-4f7f-924e-291d1665016a', '1cd3d1e9-71ad-4ec4-9f91-8ea3946ff55f'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:54 devstack sudo[84978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:00:54 devstack sudo[84978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:55 devstack sudo[84978]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 1.193s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:55 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:00:55 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Deleted volume successfully. Apr 14 03:00:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b76def87-217c-432e-bf5d-d2725a3fed96 tempest-VolumesExtendTest-992203246 None] Lock "cinder-b7d8d68f-b52f-4106-9ea4-c066f02784d6-delete_volume" released by "delete_volume" :: held 3.680s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:00:55 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:00:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Flow 'volume_create_manager' (0695301d-7d84-4c00-b3fd-b8120315b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b46b8f-5577-4299-bb9e-0105539b10e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b46b8f-5577-4299-bb9e-0105539b10e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-669636026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c20576-d337-44ed-995d-e42fa811a264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99371b7878374b9f917b24d8d940ecf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:56Z,use_quota=True,user_id='fa0b721c9fcf4215a2eee8f7eab447e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2cfa22-e315-44d4-82b5-86a3909693b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2cfa22-e315-44d4-82b5-86a3909693b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcba5c2-5169-433f-adb4-0f661422ddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcba5c2-5169-433f-adb4-0f661422ddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c20576-d337-44ed-995d-e42fa811a264', 'volume_name': 'volume-29c20576-d337-44ed-995d-e42fa811a264', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800ed625-2640-4033-a67a-12e0e4fe5eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800ed625-2640-4033-a67a-12e0e4fe5eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2d81de-db55-44ad-a43a-281642998051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:56 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Volume 29c20576-d337-44ed-995d-e42fa811a264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c20576-d337-44ed-995d-e42fa811a264', 'volume_size': 1} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-669636026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c20576-d337-44ed-995d-e42fa811a264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99371b7878374b9f917b24d8d940ecf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:00:56Z,use_quota=True,user_id='fa0b721c9fcf4215a2eee8f7eab447e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Creating volume 29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:00:56 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:56 devstack sudo[84999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 1073741824 Apr 14 03:00:56 devstack sudo[84999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:56 devstack sudo[84999]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 1073741824" returned: 0 in 0.721s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:56 devstack sudo[85010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 Apr 14 03:00:56 devstack sudo[85010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:57 devstack sudo[85010]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264" returned: 0 in 0.598s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:00:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:00:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2d81de-db55-44ad-a43a-281642998051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c20576-d337-44ed-995d-e42fa811a264', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bd70c2-2a9a-4c4f-b1b5-8cecbff45fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:00:57 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Volume volume-29c20576-d337-44ed-995d-e42fa811a264 (29c20576-d337-44ed-995d-e42fa811a264): created successfully Apr 14 03:00:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bd70c2-2a9a-4c4f-b1b5-8cecbff45fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:00:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Flow 'volume_create_manager' (0695301d-7d84-4c00-b3fd-b8120315b26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:00:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-80ef6204-2129-4a94-8b3d-852e5b487d8b tempest-VolumesExtendTest-992203246 None] Created volume successfully. Apr 14 03:00:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:00:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:00:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Creating offline snapshot 799c6134-b902-4572-bf29-5c68c6fb913f of volume 29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:00:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a8879-0fc4-4b38-8f81-3325a8ae9e5e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:00:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:58 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 Apr 14 03:00:58 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:59 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264" returned: 0 in 0.658s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:59 devstack sudo[85046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f 1G Apr 14 03:00:59 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:00:59 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root Apr 14 03:00:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f 1G" returned: 0 in 0.716s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:00:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c20576-d337-44ed-995d-e42fa811a264 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:00:59 devstack sudo[85069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c20576-d337-44ed-995d-e42fa811a264 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f Apr 14 03:00:59 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:00 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-09922261-9b62-4508-a2be-6aec50308c62 req-f07863df-f1ca-4719-b5cf-abd48bc73981 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Terminate volume connection completed successfully. Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-09922261-9b62-4508-a2be-6aec50308c62 req-f07863df-f1ca-4719-b5cf-abd48bc73981 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Deleting attachment aac6b14d-c373-4062-b09c-ae0010d68ea5. {{(pid=82473) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 14 03:01:00 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29c20576-d337-44ed-995d-e42fa811a264 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f" returned: 0 in 0.532s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:00 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f is being set with open permissions: ugo+rw Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:00 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f Apr 14 03:01:00 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "cinder-d39a46dd-4479-4154-9d66-a49f48705ee5-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "cinder-d39a46dd-4479-4154-9d66-a49f48705ee5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "cinder-quobyte-d39a46dd-4479-4154-9d66-a49f48705ee5" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "cinder-quobyte-d39a46dd-4479-4154-9d66-a49f48705ee5" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:00 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f" returned: 0 in 0.564s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e195c5a-b597-4b46-bacb-1a98e691da41]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:00 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.info Apr 14 03:01:00 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:00 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:01:00 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:01 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.info" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:01 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.info is being set with open permissions: ugo+rw Apr 14 03:01:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:01 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.info Apr 14 03:01:01 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:01 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 0 in 0.537s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:01 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:01:01 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:01 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.info" returned: 0 in 0.505s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.520s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:01 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7b576e28-f3de-4e9f-b554-54d3f1a754da tempest-VolumesExtendTest-992203246 None] Create snapshot completed successfully Apr 14 03:01:02 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 1 in 0.752s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:02 devstack sudo[85122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5 Apr 14 03:01:02 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e5e92bd-54cc-4f56-84cc-899ebc6ecd97 tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e5e92bd-54cc-4f56-84cc-899ebc6ecd97 tempest-VolumesExtendTest-992203246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd2287d-97ce-47ca-ac92-c587c8188f74]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e5e92bd-54cc-4f56-84cc-899ebc6ecd97 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:02 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 Apr 14 03:01:02 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:02 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d39a46dd-4479-4154-9d66-a49f48705ee5" returned: 0 in 0.599s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "cinder-quobyte-d39a46dd-4479-4154-9d66-a49f48705ee5" released by "delete_volume" :: held 1.959s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG cinder.quota [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Created reservations ['917a5555-2613-4276-92d7-00bc82e54550', '290d5f66-6c47-4eb2-b19f-32bd8bb26b5f', 'cd2c6737-ff7d-476e-8fe2-acf4076ed320', 'd4ed77be-7871-46db-a715-48c7fb1620db'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:02 devstack sudo[85128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:02 devstack sudo[85128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:03 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e5e92bd-54cc-4f56-84cc-899ebc6ecd97 tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264" returned: 0 in 0.572s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e5e92bd-54cc-4f56-84cc-899ebc6ecd97 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f 2G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e5e92bd-54cc-4f56-84cc-899ebc6ecd97 tempest-VolumesExtendTest-992203246 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f 2G" returned: 0 in 0.100s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e5e92bd-54cc-4f56-84cc-899ebc6ecd97 tempest-VolumesExtendTest-992203246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.689s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:03 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8e5e92bd-54cc-4f56-84cc-899ebc6ecd97 tempest-VolumesExtendTest-992203246 None] Extend volume completed successfully. Apr 14 03:01:03 devstack sudo[85128]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.549s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.manager [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:03 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Deleted volume successfully. Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-09922261-9b62-4508-a2be-6aec50308c62 req-b1bdabf6-8064-400f-b987-62c0737e5e4e tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "cinder-d39a46dd-4479-4154-9d66-a49f48705ee5-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Acquiring lock "cinder-799c6134-b902-4572-bf29-5c68c6fb913f-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Lock "cinder-799c6134-b902-4572-bf29-5c68c6fb913f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Acquiring lock "cinder-quobyte-29c20576-d337-44ed-995d-e42fa811a264" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Lock "cinder-quobyte-29c20576-d337-44ed-995d-e42fa811a264" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Acquiring lock "cinder-quobyte-799c6134-b902-4572-bf29-5c68c6fb913f" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Lock "cinder-quobyte-799c6134-b902-4572-bf29-5c68c6fb913f" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Deleting offline snapshot 799c6134-b902-4572-bf29-5c68c6fb913f of volume 29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] snapshot_file for this snap is: volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d58af43-41aa-46e1-9023-afb0c84660c7]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:04 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f Apr 14 03:01:04 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:04 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f" returned: 0 in 0.731s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29c20576-d337-44ed-995d-e42fa811a264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:01:04 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[261fb719-bda8-4ef1-aad6-0d332924ea1d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:04 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 Apr 14 03:01:04 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:05 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264" returned: 0 in 0.951s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:05 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f Apr 14 03:01:05 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:06 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f" returned: 0 in 0.592s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:06 devstack sudo[85191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f Apr 14 03:01:06 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:06 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264.799c6134-b902-4572-bf29-5c68c6fb913f" returned: 0 in 0.564s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Lock "cinder-quobyte-799c6134-b902-4572-bf29-5c68c6fb913f" released by "_delete_snapshot" :: held 2.959s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Lock "cinder-quobyte-29c20576-d337-44ed-995d-e42fa811a264" released by "delete_snapshot" :: held 3.028s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:06 devstack cinder-volume[82473]: WARNING cinder.quota [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:01:06 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Created reservations ['48663fe2-bf25-42a4-b25c-105ff70d7b48', 'a33a2d63-72f1-47a5-bb4a-6a6c89631bd5', 'c551ccae-0fac-4bb6-ada7-2f8467b9b351', '0b3f13d8-0ecb-4942-b3bb-8ce5c744fbd2'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:06 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Delete snapshot completed successfully. Apr 14 03:01:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75c80a7c-7a74-4fb3-919d-b9ad719ba212 tempest-VolumesExtendTest-992203246 None] Lock "cinder-799c6134-b902-4572-bf29-5c68c6fb913f-delete_snapshot" released by "delete_snapshot" :: held 3.170s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Acquiring lock "cinder-29c20576-d337-44ed-995d-e42fa811a264-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Lock "cinder-29c20576-d337-44ed-995d-e42fa811a264-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Acquiring lock "cinder-quobyte-29c20576-d337-44ed-995d-e42fa811a264" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Lock "cinder-quobyte-29c20576-d337-44ed-995d-e42fa811a264" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:07 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7937d9-962b-4fd5-9b2e-0fda47b614a7]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:07 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 Apr 14 03:01:07 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:07 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264" returned: 0 in 0.533s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:07 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264 Apr 14 03:01:07 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:08 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-29c20576-d337-44ed-995d-e42fa811a264" returned: 0 in 0.607s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Lock "cinder-quobyte-29c20576-d337-44ed-995d-e42fa811a264" released by "delete_volume" :: held 1.179s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Created reservations ['a269449e-5e13-4f28-834b-1804542e48fe', '4712a838-9b17-4595-99b2-925e68956ebd', 'b220b9a4-799c-4273-9730-c6b87f24d268', '4be9aa33-b757-484c-a5d3-7cdc0daadd72'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:08 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:08 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:09 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.756s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:09 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:09 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Deleted volume successfully. Apr 14 03:01:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a06c95f2-751b-455b-a1dc-28e78bb058ab tempest-VolumesExtendTest-992203246 None] Lock "cinder-29c20576-d337-44ed-995d-e42fa811a264-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (b37ffbd8-af5c-458a-8cad-7a3bf68f609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17dc8fb-3d98-4b02-a023-94a2be0e75ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17dc8fb-3d98-4b02-a023-94a2be0e75ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1383446703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef2785-7067-40b5-bc1d-0a6e1197bcd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:13Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f78ec8-a931-4c20-83e4-515a869a67d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f78ec8-a931-4c20-83e4-515a869a67d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba89e62b-62b3-4c9a-ab97-c808b06bd9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba89e62b-62b3-4c9a-ab97-c808b06bd9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ef2785-7067-40b5-bc1d-0a6e1197bcd7', 'volume_name': 'volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e0b118-40e8-4c0a-b1b7-d6c47f80c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e0b118-40e8-4c0a-b1b7-d6c47f80c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623fbdb6-2141-4cfb-9c6a-76c1e9101edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:12 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Volume 93ef2785-7067-40b5-bc1d-0a6e1197bcd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7', 'volume_size': 1} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1383446703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ef2785-7067-40b5-bc1d-0a6e1197bcd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:13Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Creating volume 93ef2785-7067-40b5-bc1d-0a6e1197bcd7 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:12 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:13 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 1073741824 Apr 14 03:01:13 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (776ea58e-1376-4669-8e5f-45fc2bcfc0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef51d16-a521-4a3d-812e-dbf20996883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ef51d16-a521-4a3d-812e-dbf20996883d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-785005903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc34bd26-ce43-4969-875f-ec3ddf827f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:13Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f51c43-51f1-473d-8409-42141a7a776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f51c43-51f1-473d-8409-42141a7a776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649f7c21-4163-40f5-ab12-fa1306380485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649f7c21-4163-40f5-ab12-fa1306380485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc34bd26-ce43-4969-875f-ec3ddf827f1f', 'volume_name': 'volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a2b005-c4be-4e30-92dd-ddfab2832d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a2b005-c4be-4e30-92dd-ddfab2832d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7bb9f4-d99e-461d-938b-d43f6444189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Volume fc34bd26-ce43-4969-875f-ec3ddf827f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f', 'volume_size': 1} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (17d99f75-79d0-4037-933f-ebc59be41772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed67daa-18f0-4137-9617-79e15360db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed67daa-18f0-4137-9617-79e15360db5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567500086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba31ea39-ca66-4594-ac51-ade223fb29f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:13Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b150015-6776-4c7d-8162-428ab24cb28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b150015-6776-4c7d-8162-428ab24cb28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d73bb1-b79f-4dc9-abbd-46882f52811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d73bb1-b79f-4dc9-abbd-46882f52811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba31ea39-ca66-4594-ac51-ade223fb29f7', 'volume_name': 'volume-ba31ea39-ca66-4594-ac51-ade223fb29f7', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5184b94b-487b-4c3c-a112-515ef34d5609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5184b94b-487b-4c3c-a112-515ef34d5609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc10890-675b-409b-a653-fb6e7eff45c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Volume ba31ea39-ca66-4594-ac51-ade223fb29f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba31ea39-ca66-4594-ac51-ade223fb29f7', 'volume_size': 1} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (54cac8da-53e9-4fb7-9d5a-dc5396fd8126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceec70aa-6fe8-4123-9a47-1a6e597bc849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceec70aa-6fe8-4123-9a47-1a6e597bc849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-499787297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30015b9c-a663-44e9-93a6-9ec84c360f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:14Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a241f4e2-2db3-4328-bd94-25d97980da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a241f4e2-2db3-4328-bd94-25d97980da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb6405b-710c-4401-b129-d3d90535a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb6405b-710c-4401-b129-d3d90535a56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30015b9c-a663-44e9-93a6-9ec84c360f20', 'volume_name': 'volume-30015b9c-a663-44e9-93a6-9ec84c360f20', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522279f9-948f-4a2c-a19d-5c70f2cd3b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522279f9-948f-4a2c-a19d-5c70f2cd3b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2671f0-f822-46ac-a094-778a16f873e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:13 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Volume 30015b9c-a663-44e9-93a6-9ec84c360f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30015b9c-a663-44e9-93a6-9ec84c360f20', 'volume_size': 1} Apr 14 03:01:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:14 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 1073741824" returned: 0 in 1.386s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (76559f69-8bbe-4914-9951-5820d6fd41ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f7e2b1-d0ad-4769-9643-6e7ac5ad7f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:14 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 Apr 14 03:01:14 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f7e2b1-d0ad-4769-9643-6e7ac5ad7f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-56018872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c9646a-70cc-4bb4-a746-ddf4c4150eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:14Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23ae8f3-a7c8-49df-9b11-2e09359e5831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23ae8f3-a7c8-49df-9b11-2e09359e5831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17778f0-8f8b-4f28-982e-a9e12f44d22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17778f0-8f8b-4f28-982e-a9e12f44d22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c9646a-70cc-4bb4-a746-ddf4c4150eea', 'volume_name': 'volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289c86bb-f32c-4e69-80f8-1c473323e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289c86bb-f32c-4e69-80f8-1c473323e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec36d2d-991f-4549-98f0-e55f0b76a46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:14 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Volume 73c9646a-70cc-4bb4-a746-ddf4c4150eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea', 'volume_size': 1} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:14 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:14 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:15 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7" returned: 0 in 0.616s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.752s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-785005903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc34bd26-ce43-4969-875f-ec3ddf827f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:13Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Creating volume fc34bd26-ce43-4969-875f-ec3ddf827f1f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:15 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623fbdb6-2141-4cfb-9c6a-76c1e9101edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b4066f-3bb8-4f0b-a58d-bcd9e7f82b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:15 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f 1073741824 Apr 14 03:01:15 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:15 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Volume volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 (93ef2785-7067-40b5-bc1d-0a6e1197bcd7): created successfully Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b4066f-3bb8-4f0b-a58d-bcd9e7f82b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (b37ffbd8-af5c-458a-8cad-7a3bf68f609e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:15 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9ae3de7b-430a-456b-add8-7dda095fb756 tempest-CreateVolumesFromImageTest-8900862 None] Created volume successfully. Apr 14 03:01:15 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.641s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:15 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f 1073741824" returned: 0 in 0.782s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:16 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f Apr 14 03:01:16 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (ed9201d3-43f6-4225-a628-dc6e4cda0153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127db8f2-8ea5-41dc-a1f9-10f19283b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127db8f2-8ea5-41dc-a1f9-10f19283b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1238816927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1982d2c8-a978-41f3-8e2e-b869a4d5beeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:16Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7139ba-ee50-405d-9be3-7c5e8787e400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7139ba-ee50-405d-9be3-7c5e8787e400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d3d3a5-2523-4be2-9852-b1aad195f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d3d3a5-2523-4be2-9852-b1aad195f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1982d2c8-a978-41f3-8e2e-b869a4d5beeb', 'volume_name': 'volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bfc709-697d-4edf-85d7-c6358dc7c468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bfc709-697d-4edf-85d7-c6358dc7c468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1f5994-fa6a-40cd-bdce-4f853dd39694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:16 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Volume 1982d2c8-a978-41f3-8e2e-b869a4d5beeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb', 'volume_size': 1} Apr 14 03:01:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:17 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f" returned: 0 in 1.300s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.781s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1567500086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba31ea39-ca66-4594-ac51-ade223fb29f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:13Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Creating volume ba31ea39-ca66-4594-ac51-ade223fb29f7 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:17 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7bb9f4-d99e-461d-938b-d43f6444189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c184be-d221-4485-a3cc-aaa792e20385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:17 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Volume volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f (fc34bd26-ce43-4969-875f-ec3ddf827f1f): created successfully Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c184be-d221-4485-a3cc-aaa792e20385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:17 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 1073741824 Apr 14 03:01:17 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (776ea58e-1376-4669-8e5f-45fc2bcfc0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:17 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-17985126-b062-4cc0-9c2b-8bdc818db2f8 tempest-CreateVolumesFromImageTest-8900862 None] Created volume successfully. Apr 14 03:01:18 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 1073741824" returned: 0 in 1.477s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:18 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 Apr 14 03:01:18 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Flow 'volume_create_manager' (175709a3-7087-4aee-8c2c-ca4a5ef584e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607f3df0-3c8a-4e67-8316-a7bd9ecc00ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607f3df0-3c8a-4e67-8316-a7bd9ecc00ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1421352012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2087a95b-f4f7-429f-b600-5dfc37db4cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5237aed600435ca4f5e0292d6ad424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:19Z,use_quota=True,user_id='5abc9fb6d9314e5e87ac3528d2ecf66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5743318-e68a-4eb0-9875-9ec5f9951fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5743318-e68a-4eb0-9875-9ec5f9951fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2752dede-dd56-4e44-8999-9dac12f5a0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2752dede-dd56-4e44-8999-9dac12f5a0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2087a95b-f4f7-429f-b600-5dfc37db4cd1', 'volume_name': 'volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647c8215-3a72-4350-9a79-7824cc247b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647c8215-3a72-4350-9a79-7824cc247b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c729010-f167-4431-85c8-e1d4f87b2061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:19 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Volume 2087a95b-f4f7-429f-b600-5dfc37db4cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1', 'volume_size': 1} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:19 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7" returned: 0 in 0.585s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.457s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-499787297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30015b9c-a663-44e9-93a6-9ec84c360f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:14Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Creating volume 30015b9c-a663-44e9-93a6-9ec84c360f20 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:19 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc10890-675b-409b-a653-fb6e7eff45c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba31ea39-ca66-4594-ac51-ade223fb29f7', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66f6ee4-00a9-4956-9553-325731f63bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:19 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Volume volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 (ba31ea39-ca66-4594-ac51-ade223fb29f7): created successfully Apr 14 03:01:19 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 1073741824 Apr 14 03:01:19 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b66f6ee4-00a9-4956-9553-325731f63bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (17d99f75-79d0-4037-933f-ebc59be41772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:19 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9c476a41-c211-4701-bb73-3e4fe7b51eff tempest-CreateVolumesFromImageTest-8900862 None] Created volume successfully. Apr 14 03:01:19 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-92e88c98-aea5-4c62-aed2-0b6dcb4f4ff9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Terminate volume connection completed successfully. Apr 14 03:01:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-92e88c98-aea5-4c62-aed2-0b6dcb4f4ff9 tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Deleting attachment e6692697-e6e3-41dd-847c-d53293769a8f. {{(pid=82473) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 14 03:01:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "cinder-7fd3103d-cb77-463d-9a94-84891ea19efa-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "cinder-7fd3103d-cb77-463d-9a94-84891ea19efa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "cinder-quobyte-7fd3103d-cb77-463d-9a94-84891ea19efa" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "cinder-quobyte-7fd3103d-cb77-463d-9a94-84891ea19efa" acquired by "delete_volume" :: waited 0.020s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f5a5cc-0ea2-4010-848f-c600107e311d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:20 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 1073741824" returned: 0 in 1.031s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:20 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 Apr 14 03:01:20 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:20 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa Apr 14 03:01:20 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:21 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:21 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa" returned: 0 in 0.865s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20" returned: 0 in 0.795s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.771s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-56018872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c9646a-70cc-4bb4-a746-ddf4c4150eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14e4f7277484106af0993afdc37520c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:14Z,use_quota=True,user_id='a7e720f4658c45dbb7e6052e628fbef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Creating volume 73c9646a-70cc-4bb4-a746-ddf4c4150eea {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:21 devstack sudo[85421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa Apr 14 03:01:21 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:21 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2671f0-f822-46ac-a094-778a16f873e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30015b9c-a663-44e9-93a6-9ec84c360f20', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214a6093-e08e-4b19-8ddd-1a182f33a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:21 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea 1073741824 Apr 14 03:01:21 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:21 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Volume volume-30015b9c-a663-44e9-93a6-9ec84c360f20 (30015b9c-a663-44e9-93a6-9ec84c360f20): created successfully Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214a6093-e08e-4b19-8ddd-1a182f33a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (54cac8da-53e9-4fb7-9d5a-dc5396fd8126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:21 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7c7cb4ff-45a5-4ca5-83e5-47872d6ae5e4 tempest-CreateVolumesFromImageTest-8900862 None] Created volume successfully. Apr 14 03:01:21 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7fd3103d-cb77-463d-9a94-84891ea19efa" returned: 0 in 0.619s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "cinder-quobyte-7fd3103d-cb77-463d-9a94-84891ea19efa" released by "delete_volume" :: held 1.587s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.quota [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Created reservations ['48a67121-2462-450f-a944-2e7ca36be1b6', 'e58f73c2-0d71-4349-8eae-2c4a9c6d948e', 'da0cf3b2-2794-4914-a281-d96e98ea724f', 'fdbf4128-ba00-47c1-8233-46a5970b78ff'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:21 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:21 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:22 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea 1073741824" returned: 0 in 1.102s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:22 devstack sudo[85431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea Apr 14 03:01:22 devstack sudo[85431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:22 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.696s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.manager [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:22 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Deleted volume successfully. Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-72b32fef-21ce-4cd1-9f8f-cf7f5ad0aa4a req-6585be70-6433-4038-99b0-967ae55dbf0b tempest-ServerBootFromVolumeStableRescueTest-950352079 None] Lock "cinder-7fd3103d-cb77-463d-9a94-84891ea19efa-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:22 devstack sudo[85431]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.216s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1238816927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1982d2c8-a978-41f3-8e2e-b869a4d5beeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:16Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Creating volume 1982d2c8-a978-41f3-8e2e-b869a4d5beeb {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:22 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec36d2d-991f-4549-98f0-e55f0b76a46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:22 devstack sudo[85435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb 1073741824 Apr 14 03:01:22 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96755d5a-1370-4fea-8c1b-f440997a2126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:22 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Volume volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea (73c9646a-70cc-4bb4-a746-ddf4c4150eea): created successfully Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96755d5a-1370-4fea-8c1b-f440997a2126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Flow 'volume_create_manager' (76559f69-8bbe-4914-9951-5820d6fd41ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-4c083eda-86c4-4076-9141-62ece5d154a0 tempest-CreateVolumesFromImageTest-8900862 None] Created volume successfully. Apr 14 03:01:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-73c9646a-70cc-4bb4-a746-ddf4c4150eea-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-73c9646a-70cc-4bb4-a746-ddf4c4150eea-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-quobyte-73c9646a-70cc-4bb4-a746-ddf4c4150eea" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-73c9646a-70cc-4bb4-a746-ddf4c4150eea" acquired by "delete_volume" :: waited 0.034s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:23 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5248f9f4-fb1f-4473-b0c2-31e7b5db7aa6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:23 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb 1073741824" returned: 0 in 0.933s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:23 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea Apr 14 03:01:23 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:23 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb Apr 14 03:01:23 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:24 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" returned: 0 in 0.596s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.396s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1421352012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2087a95b-f4f7-429f-b600-5dfc37db4cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5237aed600435ca4f5e0292d6ad424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:19Z,use_quota=True,user_id='5abc9fb6d9314e5e87ac3528d2ecf66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Creating volume 2087a95b-f4f7-429f-b600-5dfc37db4cd1 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:24 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1f5994-fa6a-40cd-bdce-4f853dd39694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:24 devstack sudo[85445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 1073741824 Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5e3b52-387b-424c-ad78-d900511a4125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:24 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:24 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Volume volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb (1982d2c8-a978-41f3-8e2e-b869a4d5beeb): created successfully Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5e3b52-387b-424c-ad78-d900511a4125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (ed9201d3-43f6-4225-a628-dc6e4cda0153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6dd53294-e951-4a2f-bc62-bbc9522b4813 tempest-VolumesActionsTest-1583563942 None] Created volume successfully. Apr 14 03:01:24 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea" returned: 0 in 1.100s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:24 devstack sudo[85452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea Apr 14 03:01:24 devstack sudo[85452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6c98b8a6-e4cf-4ca9-a4a0-40ab212230b5 tempest-VolumesActionsTest-1583563942 None] Acquiring lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" by "attach_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6c98b8a6-e4cf-4ca9-a4a0-40ab212230b5 tempest-VolumesActionsTest-1583563942 None] Lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" acquired by "attach_volume" :: waited 0.059s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:25 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6c98b8a6-e4cf-4ca9-a4a0-40ab212230b5 tempest-VolumesActionsTest-1583563942 None] Attaching volume 1982d2c8-a978-41f3-8e2e-b869a4d5beeb to instance 30e18ac7-98ea-4613-a8a3-4f7ea0bb9402 at mountpoint /dev/vdb on host None. Apr 14 03:01:25 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6c98b8a6-e4cf-4ca9-a4a0-40ab212230b5 tempest-VolumesActionsTest-1583563942 None] Attach volume completed successfully. Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6c98b8a6-e4cf-4ca9-a4a0-40ab212230b5 tempest-VolumesActionsTest-1583563942 None] Lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" released by "attach_volume" :: held 0.219s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:25 devstack sudo[85452]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-73c9646a-70cc-4bb4-a746-ddf4c4150eea" returned: 0 in 0.817s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-73c9646a-70cc-4bb4-a746-ddf4c4150eea" released by "delete_volume" :: held 1.994s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Created reservations ['4835d2b2-3c8b-4cdc-9085-837b2cf1356a', '19a9c924-0f21-4850-b938-809a73bfb74d', 'bfdbbe93-1db9-4b23-b24a-5550eb31693c', 'c351b0c4-7e24-4ba2-8421-7db3e02e3e1b'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:25 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 1073741824" returned: 0 in 1.443s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:25 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:25 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:26 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 Apr 14 03:01:26 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:26 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-da8516c0-aa55-4732-aec9-077fda86b7fe tempest-VolumesActionsTest-813145945 None] Terminate volume connection completed successfully. Apr 14 03:01:26 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.923s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:26 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:26 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Deleted volume successfully. Apr 14 03:01:26 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9173d2b4-f068-4651-b208-53d7bddf67b2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-73c9646a-70cc-4bb4-a746-ddf4c4150eea-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-30015b9c-a663-44e9-93a6-9ec84c360f20-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-30015b9c-a663-44e9-93a6-9ec84c360f20-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:27 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-quobyte-30015b9c-a663-44e9-93a6-9ec84c360f20" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1" returned: 0 in 1.054s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] <== create_volume: return (2611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c729010-f167-4431-85c8-e1d4f87b2061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67299d1-2a9e-4a25-86da-8efeea17c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-30015b9c-a663-44e9-93a6-9ec84c360f20" acquired by "delete_volume" :: waited 0.079s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:27 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Volume volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 (2087a95b-f4f7-429f-b600-5dfc37db4cd1): created successfully Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67299d1-2a9e-4a25-86da-8efeea17c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Flow 'volume_create_manager' (175709a3-7087-4aee-8c2c-ca4a5ef584e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ef0bf996-25dc-441b-aae6-6f28e1267313 tempest-ServerRescueNegativeTestJSON-1358313460 None] Created volume successfully. Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3996733-64a6-43b8-94de-0748f3ff35ca]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-da8516c0-aa55-4732-aec9-077fda86b7fe tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-detach_volume" by "detach_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-da8516c0-aa55-4732-aec9-077fda86b7fe tempest-VolumesActionsTest-813145945 None] Lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-da8516c0-aa55-4732-aec9-077fda86b7fe tempest-VolumesActionsTest-813145945 None] Detaching volume 1982d2c8-a978-41f3-8e2e-b869a4d5beeb from instance 30e18ac7-98ea-4613-a8a3-4f7ea0bb9402. Apr 14 03:01:27 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 Apr 14 03:01:27 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-da8516c0-aa55-4732-aec9-077fda86b7fe tempest-VolumesActionsTest-813145945 None] Detach volume completed successfully. Apr 14 03:01:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-da8516c0-aa55-4732-aec9-077fda86b7fe tempest-VolumesActionsTest-813145945 None] Lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b9faa468-77ff-4ffb-91b5-7a27ea0c61c5 tempest-VolumesActionsTest-1583563942 None] Acquiring lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-detach_volume" by "detach_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b9faa468-77ff-4ffb-91b5-7a27ea0c61c5 tempest-VolumesActionsTest-1583563942 None] Lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:28 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b9faa468-77ff-4ffb-91b5-7a27ea0c61c5 tempest-VolumesActionsTest-1583563942 None] Volume detach called, but volume not attached. Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b9faa468-77ff-4ffb-91b5-7a27ea0c61c5 tempest-VolumesActionsTest-1583563942 None] Lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:28 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20" returned: 0 in 1.045s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:28 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20 Apr 14 03:01:28 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Acquiring lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Acquiring lock "cinder-quobyte-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Lock "cinder-quobyte-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:28 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-30015b9c-a663-44e9-93a6-9ec84c360f20" returned: 0 in 0.679s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-30015b9c-a663-44e9-93a6-9ec84c360f20" released by "delete_volume" :: held 1.805s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a7c7a8-f2e2-4f7f-823b-7a91df8ed753]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Created reservations ['c5939747-05c6-4639-a2c9-a64c6c5dcd80', 'e679c25c-0eeb-4b8d-b13c-731702ad0b94', '51ed6c06-d8b6-4793-af96-31aaf19a3370', '4139e404-e258-40b0-b477-f9019b3ff152'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:29 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb Apr 14 03:01:29 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:29 devstack sudo[85499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:29 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-ba31ea39-ca66-4594-ac51-ade223fb29f7-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-ba31ea39-ca66-4594-ac51-ade223fb29f7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-quobyte-ba31ea39-ca66-4594-ac51-ade223fb29f7" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-ba31ea39-ca66-4594-ac51-ade223fb29f7" acquired by "delete_volume" :: waited 0.022s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[370cea5e-aa22-49cb-a0fc-64acf3e266fa]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:29 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 Apr 14 03:01:29 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:30 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" returned: 0 in 1.228s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:30 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb Apr 14 03:01:30 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:30 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 1.162s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:30 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Deleted volume successfully. Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-523e04c3-8332-4bbb-8ba9-782b88d6301e tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-30015b9c-a663-44e9-93a6-9ec84c360f20-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:30 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" returned: 0 in 0.613s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Lock "cinder-quobyte-1982d2c8-a978-41f3-8e2e-b869a4d5beeb" released by "delete_volume" :: held 1.923s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Created reservations ['d58c3f6c-8e1a-4eda-bdbf-838aa37c1b09', '95180dc5-c5bb-47e9-9168-69c0994de7e3', 'c4ba4b47-54d9-44bd-b8ba-f02535c1b76a', '9f70759b-dc9e-4934-bb03-7154d8cb1573'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:31 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7" returned: 0 in 1.354s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:31 devstack sudo[85513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:31 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:31 devstack sudo[85514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7 Apr 14 03:01:31 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:32 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 1.033s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Deleted volume successfully. Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-19095be8-5948-41fd-986c-f9894580f73d tempest-VolumesActionsTest-1583563942 None] Lock "cinder-1982d2c8-a978-41f3-8e2e-b869a4d5beeb-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:32 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba31ea39-ca66-4594-ac51-ade223fb29f7" returned: 0 in 1.243s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-ba31ea39-ca66-4594-ac51-ade223fb29f7" released by "delete_volume" :: held 2.685s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Created reservations ['e9678fbe-3526-43db-81f2-08c942c80897', '5e4980a9-885e-4165-aa12-82bbc941a54d', '369fcefe-355c-45d1-a059-3ae275ec20fb', '4be22a37-ad5c-44a7-8728-7932232bf34e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:32 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:32 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-fc34bd26-ce43-4969-875f-ec3ddf827f1f-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-fc34bd26-ce43-4969-875f-ec3ddf827f1f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-quobyte-fc34bd26-ce43-4969-875f-ec3ddf827f1f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-fc34bd26-ce43-4969-875f-ec3ddf827f1f" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f227b83d-4c1b-42a3-84d5-c84f85ea508f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:33 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f Apr 14 03:01:33 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:33 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.848s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:33 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Deleted volume successfully. Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f68147a3-f55c-48a9-a550-4a1915c05fe2 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-ba31ea39-ca66-4594-ac51-ade223fb29f7-delete_volume" released by "delete_volume" :: held 3.976s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:33 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f" returned: 0 in 0.720s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:33 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f Apr 14 03:01:33 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:34 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fc34bd26-ce43-4969-875f-ec3ddf827f1f" returned: 0 in 0.621s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-fc34bd26-ce43-4969-875f-ec3ddf827f1f" released by "delete_volume" :: held 1.430s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Created reservations ['84c34232-6d6b-43c6-a3a3-6998fe37822a', 'b69c517f-75aa-47fb-a4ce-62a3a1dcd654', '03618ce2-4fb4-42f1-a0ca-a00f7958214d', '9a7a71aa-4ed1-4792-8631-5fb4d8410331'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:34 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:34 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-93ef2785-7067-40b5-bc1d-0a6e1197bcd7-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-93ef2785-7067-40b5-bc1d-0a6e1197bcd7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:35 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.653s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Deleted volume successfully. Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "cinder-quobyte-93ef2785-7067-40b5-bc1d-0a6e1197bcd7" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-abe52d42-0b11-4af6-9bbb-5dac2fc4b1f6 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-fc34bd26-ce43-4969-875f-ec3ddf827f1f-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-93ef2785-7067-40b5-bc1d-0a6e1197bcd7" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bda3c75-226b-4b2f-b077-52804a9adf42]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:35 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 Apr 14 03:01:35 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:36 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7" returned: 0 in 0.686s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:36 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7 Apr 14 03:01:36 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:36 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-93ef2785-7067-40b5-bc1d-0a6e1197bcd7" returned: 0 in 0.461s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-quobyte-93ef2785-7067-40b5-bc1d-0a6e1197bcd7" released by "delete_volume" :: held 1.181s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Created reservations ['21ad5f5f-bdfc-43f8-9bcf-f4d6817e962b', '2c4efa53-109b-4cc2-abc3-c352428e9a47', 'a77da63a-4ac1-43a0-a13e-37b024c5e382', '862e9c45-ff63-4407-bfbd-9abe8c22b51a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:36 devstack sudo[85607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:36 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:37 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.511s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:37 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Deleted volume successfully. Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a3a9caea-8eae-4fae-910b-2aa313f9f0b3 tempest-CreateVolumesFromImageTest-8900862 None] Lock "cinder-93ef2785-7067-40b5-bc1d-0a6e1197bcd7-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Flow 'volume_create_manager' (40c0d096-44f9-4652-a85d-dddbeb11cf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e89c996-334b-44d6-a918-222338d66528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e89c996-334b-44d6-a918-222338d66528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1724651036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b238ba4-77c1-4960-9258-a8c440ef62b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58e43b4594ff45ba9d0e4bf415504f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:37Z,use_quota=True,user_id='b43f489b61204128ab4a34bf886fedcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a811f090-cabb-4df5-aaa4-3ab327c060b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a811f090-cabb-4df5-aaa4-3ab327c060b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb7393-11ea-496f-81d1-99f589256f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb7393-11ea-496f-81d1-99f589256f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b238ba4-77c1-4960-9258-a8c440ef62b6', 'volume_name': 'volume-4b238ba4-77c1-4960-9258-a8c440ef62b6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4264b6a2-3bd6-49d6-a627-68b3f6e923e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4264b6a2-3bd6-49d6-a627-68b3f6e923e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a07582-9d7f-4be6-8da4-41d8182e6ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:37 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Volume 4b238ba4-77c1-4960-9258-a8c440ef62b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b238ba4-77c1-4960-9258-a8c440ef62b6', 'volume_size': 1} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1724651036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b238ba4-77c1-4960-9258-a8c440ef62b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='58e43b4594ff45ba9d0e4bf415504f42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:37Z,use_quota=True,user_id='b43f489b61204128ab4a34bf886fedcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Creating volume 4b238ba4-77c1-4960-9258-a8c440ef62b6 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:37 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:37 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 1073741824 Apr 14 03:01:37 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (1a7a7c8c-5709-4ac2-943b-5a9750f6cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf8f4c5-92f3-48d3-ba6d-98281a11a0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf8f4c5-92f3-48d3-ba6d-98281a11a0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058406690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583b4e00-7452-4ffc-ac73-482f7bf222ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:39Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6198369-e29d-4319-80c8-e8f35491b84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6198369-e29d-4319-80c8-e8f35491b84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0918ccb2-9079-497e-8fb4-9c24529f1e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0918ccb2-9079-497e-8fb4-9c24529f1e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583b4e00-7452-4ffc-ac73-482f7bf222ed', 'volume_name': 'volume-583b4e00-7452-4ffc-ac73-482f7bf222ed', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c615803-9e16-4cee-b66d-20d92c53de5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c615803-9e16-4cee-b66d-20d92c53de5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7279d371-4784-443c-941d-63cbee32fa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:38 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Volume 583b4e00-7452-4ffc-ac73-482f7bf222ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583b4e00-7452-4ffc-ac73-482f7bf222ed', 'volume_size': 1} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:38 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 1073741824" returned: 0 in 1.321s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:38 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 Apr 14 03:01:38 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:39 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6" returned: 0 in 0.662s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058406690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583b4e00-7452-4ffc-ac73-482f7bf222ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:39Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Creating volume 583b4e00-7452-4ffc-ac73-482f7bf222ed {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:39 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a07582-9d7f-4be6-8da4-41d8182e6ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b238ba4-77c1-4960-9258-a8c440ef62b6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d10e848-47f9-43b9-8ee6-b277b88c6200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:39 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Volume volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 (4b238ba4-77c1-4960-9258-a8c440ef62b6): created successfully Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d10e848-47f9-43b9-8ee6-b277b88c6200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Flow 'volume_create_manager' (40c0d096-44f9-4652-a85d-dddbeb11cf2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:39 devstack sudo[85647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed 1073741824 Apr 14 03:01:39 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:39 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-f6f96e18-1033-4318-9522-16f73548fe1d req-628a7851-c212-4e83-883f-a8d4c0db9a1e tempest-VolumesGetTestJSON-1498113549 None] Created volume successfully. Apr 14 03:01:40 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed 1073741824" returned: 0 in 0.925s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:40 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed Apr 14 03:01:40 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Flow 'volume_create_manager' (b98937d8-2186-4bbc-8459-53fd44b34e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d00851-e2cf-4efc-a005-3a018faf964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d00851-e2cf-4efc-a005-3a018faf964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-638906743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ceeab25-8345-42d2-8aea-5d0b1435dd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e79f391dd47455291618f23ff08603a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:40Z,use_quota=True,user_id='00293de8eb28407c9ebc1a82f2d99934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fc4154-e0dd-4095-bb33-5a0921774108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fc4154-e0dd-4095-bb33-5a0921774108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958cf6b8-f527-4748-a6ad-2142f9d348cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958cf6b8-f527-4748-a6ad-2142f9d348cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ceeab25-8345-42d2-8aea-5d0b1435dd41', 'volume_name': 'volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da7b727-871d-404d-8fc2-f93a8ce0af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da7b727-871d-404d-8fc2-f93a8ce0af0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5c2988-7c66-4887-9458-1e225a38829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:40 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Volume 0ceeab25-8345-42d2-8aea-5d0b1435dd41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41', 'volume_size': 1} Apr 14 03:01:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Acquiring lock "cinder-4b238ba4-77c1-4960-9258-a8c440ef62b6-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Lock "cinder-4b238ba4-77c1-4960-9258-a8c440ef62b6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Acquiring lock "cinder-quobyte-4b238ba4-77c1-4960-9258-a8c440ef62b6" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Lock "cinder-quobyte-4b238ba4-77c1-4960-9258-a8c440ef62b6" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c41170-833a-4dcf-88fe-c4ac9932a8f0]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:41 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed" returned: 0 in 0.802s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-638906743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ceeab25-8345-42d2-8aea-5d0b1435dd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e79f391dd47455291618f23ff08603a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:40Z,use_quota=True,user_id='00293de8eb28407c9ebc1a82f2d99934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Creating volume 0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:41 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7279d371-4784-443c-941d-63cbee32fa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583b4e00-7452-4ffc-ac73-482f7bf222ed', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6675fa-cfc2-488a-a7e9-f955bcf54edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:41 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Volume volume-583b4e00-7452-4ffc-ac73-482f7bf222ed (583b4e00-7452-4ffc-ac73-482f7bf222ed): created successfully Apr 14 03:01:41 devstack sudo[85657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 1073741824 Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6675fa-cfc2-488a-a7e9-f955bcf54edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:41 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (1a7a7c8c-5709-4ac2-943b-5a9750f6cf79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:41 devstack sudo[85656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 Apr 14 03:01:41 devstack sudo[85656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:41 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f9aaa05f-87ae-4e12-b5f9-1131fc06e847 tempest-VolumesActionsTest-1583563942 None] Created volume successfully. Apr 14 03:01:41 devstack sudo[85656]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6" returned: 0 in 0.667s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:41 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6 Apr 14 03:01:41 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:41 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 1073741824" returned: 0 in 0.718s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-583b4e00-7452-4ffc-ac73-482f7bf222ed-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Lock "cinder-583b4e00-7452-4ffc-ac73-482f7bf222ed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:42 devstack sudo[85668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 Apr 14 03:01:42 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-quobyte-583b4e00-7452-4ffc-ac73-482f7bf222ed" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Lock "cinder-quobyte-583b4e00-7452-4ffc-ac73-482f7bf222ed" acquired by "delete_volume" :: waited 0.022s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e21ac7-d596-4c7c-a6ec-8d1fcee9e589]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:42 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed Apr 14 03:01:42 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:42 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4b238ba4-77c1-4960-9258-a8c440ef62b6" returned: 0 in 0.697s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Lock "cinder-quobyte-4b238ba4-77c1-4960-9258-a8c440ef62b6" released by "delete_volume" :: held 1.399s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG cinder.quota [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Created reservations ['0089fbe4-ddf5-4954-8670-3f6aaf77cfa5', '579441c9-8c80-462a-a964-48b0fb9db3ca', 'd34eebde-8ee2-4dd6-8547-7e38c5ee5490', '1a8399b0-da0c-402f-b68e-70a2669758b2'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:42 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:42 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:42 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41" returned: 0 in 0.960s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=100,cinder:INSERT=24,cinder:UPDATE=160,cinder:DELETE=13 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5c2988-7c66-4887-9458-1e225a38829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:43 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c058a0-ae9b-44f9-b6af-f68b4df267ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:UPDATE=120,cinder:SELECT=113,cinder:INSERT=51,cinder:DELETE=9 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed" returned: 0 in 0.937s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:43 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Volume volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 (0ceeab25-8345-42d2-8aea-5d0b1435dd41): created successfully Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c058a0-ae9b-44f9-b6af-f68b4df267ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Flow 'volume_create_manager' (b98937d8-2186-4bbc-8459-53fd44b34e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:43 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f9b23bed-d4c5-4f1f-9abf-f2c685c86f3b tempest-VolumeDependencyTests-2107316729 None] Created volume successfully. Apr 14 03:01:43 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed Apr 14 03:01:43 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:43 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.642s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG cinder.manager [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:43 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Deleted volume successfully. Apr 14 03:01:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-dc65de7e-2521-47c5-9752-d8d8714b411a req-c334f90d-3cde-40be-b3d3-b800252a49d5 tempest-VolumesGetTestJSON-1498113549 None] Lock "cinder-4b238ba4-77c1-4960-9258-a8c440ef62b6-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:44 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-583b4e00-7452-4ffc-ac73-482f7bf222ed" returned: 0 in 0.995s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Lock "cinder-quobyte-583b4e00-7452-4ffc-ac73-482f7bf222ed" released by "delete_volume" :: held 1.978s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Creating offline snapshot adc29034-424a-4daa-9a1f-ec50ca0a2a0c of volume 0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27cd878-8afe-493e-b136-e988df472f29]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Created reservations ['08917a97-8710-46bd-8500-ba5cdae988d4', '0d627e1c-3e0e-4057-8f4a-a6dccac23106', '4bf01e42-10ed-4028-86b4-80db710a8df9', '43c6a9bf-cd1d-450e-8209-784580654720'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:44 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 Apr 14 03:01:44 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:44 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:44 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:44 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41" returned: 0 in 0.663s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:44 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c 1G Apr 14 03:01:44 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:45 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.888s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:45 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Deleted volume successfully. Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-407a490c-c3d5-425a-932e-e8b6e56b9de3 tempest-VolumesActionsTest-813145945 None] Lock "cinder-583b4e00-7452-4ffc-ac73-482f7bf222ed-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Acquiring lock "cinder-2087a95b-f4f7-429f-b600-5dfc37db4cd1-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "cinder-2087a95b-f4f7-429f-b600-5dfc37db4cd1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Acquiring lock "cinder-quobyte-2087a95b-f4f7-429f-b600-5dfc37db4cd1" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "cinder-quobyte-2087a95b-f4f7-429f-b600-5dfc37db4cd1" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0122763f-17d7-4f48-b4cc-45ab9ea108b6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:45 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 Apr 14 03:01:45 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:45 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c 1G" returned: 0 in 0.986s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:45 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c Apr 14 03:01:45 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (7e471315-c291-489f-b73e-5e751ad1d999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b05051-a1dd-48d1-b41d-abd0f5afef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b05051-a1dd-48d1-b41d-abd0f5afef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-783065565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:46Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6da1ec-37a6-49dd-be6f-50643510e256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6da1ec-37a6-49dd-be6f-50643510e256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a234ec2-a1b5-4602-9e29-e35dbf4e0674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a234ec2-a1b5-4602-9e29-e35dbf4e0674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f2ffbf-0ce0-4bfa-baf7-793d36a293f1', 'volume_name': 'volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058d92c-a344-4f26-9248-02d90c8de236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058d92c-a344-4f26-9248-02d90c8de236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee8a126-6224-4bd2-a8e4-001e15b99f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:46 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Volume d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1', 'volume_size': 1} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:46 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1" returned: 0 in 0.813s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:46 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1 Apr 14 03:01:46 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:46 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c" returned: 0 in 0.905s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:46 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c is being set with open permissions: ugo+rw Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:46 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c Apr 14 03:01:46 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:46 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2087a95b-f4f7-429f-b600-5dfc37db4cd1" returned: 0 in 0.565s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "cinder-quobyte-2087a95b-f4f7-429f-b600-5dfc37db4cd1" released by "delete_volume" :: held 1.412s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Created reservations ['34c8ea60-7956-44f4-9bdf-27b44b7279f2', 'a143e138-5b5c-4831-a777-de3ff2cf8386', '665f1e34-1f71-4a6c-b619-85c28b8a7327', '27e3ca83-c16b-4c54-be36-233be2711046'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:47 devstack sudo[85790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:47 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:47 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c" returned: 0 in 0.611s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:47 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.info Apr 14 03:01:47 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:47 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.788s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:47 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Deleted volume successfully. Apr 14 03:01:47 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-22b952e8-3978-4e7a-960c-30b4e258a51c tempest-ServerRescueNegativeTestJSON-1358313460 None] Lock "cinder-2087a95b-f4f7-429f-b600-5dfc37db4cd1-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Flow 'volume_create_manager' (3f5e69b6-f31d-4b7f-a009-a1ee3eb551a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d70b891-3261-4a61-8604-ff1ec48299d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d70b891-3261-4a61-8604-ff1ec48299d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-278599698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bd67ae-833b-4492-8cfe-3671e608641b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf3f0c775d84ded9d1d0e069d380a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:48Z,use_quota=True,user_id='e9a1e9ffe3c6481e803821ffa3383914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0f077a-a7b8-4111-8df9-81ae32f7b0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0f077a-a7b8-4111-8df9-81ae32f7b0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993242e3-2200-46a3-8972-8e1a2fcfba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993242e3-2200-46a3-8972-8e1a2fcfba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24bd67ae-833b-4492-8cfe-3671e608641b', 'volume_name': 'volume-24bd67ae-833b-4492-8cfe-3671e608641b', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:48 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e4f6d2-4682-4b49-b08b-45effea56a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e4f6d2-4682-4b49-b08b-45effea56a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d73b3d7-264c-4895-80d8-186c211cd0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:48 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Volume 24bd67ae-833b-4492-8cfe-3671e608641b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24bd67ae-833b-4492-8cfe-3671e608641b', 'volume_size': 1} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.info" returned: 0 in 0.685s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:48 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.info is being set with open permissions: ugo+rw Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:48 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.info Apr 14 03:01:48 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:48 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.info" returned: 0 in 0.446s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.469s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-783065565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:46Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Creating volume d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:48 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:48 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-1dbd3610-ba8c-4bbc-ac66-80573a192601 tempest-VolumeDependencyTests-2107316729 None] Create snapshot completed successfully Apr 14 03:01:48 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 1073741824 Apr 14 03:01:48 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:49 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 1073741824" returned: 0 in 0.680s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:49 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 Apr 14 03:01:49 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Flow 'volume_create_manager' (7fe4cee3-0970-4b1b-895b-8b959ca917e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5924baf-bcc3-4140-8904-fa7817885395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5924baf-bcc3-4140-8904-fa7817885395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1805897481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce3d092-858f-480f-aa76-b79654de8eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e79f391dd47455291618f23ff08603a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=adc29034-424a-4daa-9a1f-ec50ca0a2a0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:50Z,use_quota=True,user_id='00293de8eb28407c9ebc1a82f2d99934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5348b814-c3f1-45de-9ed6-1d93a35ab136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5348b814-c3f1-45de-9ed6-1d93a35ab136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81709a10-22e0-4879-9c18-9a0520aea080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81709a10-22e0-4879-9c18-9a0520aea080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ce3d092-858f-480f-aa76-b79654de8eec', 'volume_name': 'volume-3ce3d092-858f-480f-aa76-b79654de8eec', 'volume_size': 1, 'snapshot_id': 'adc29034-424a-4daa-9a1f-ec50ca0a2a0c'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757288f5-1483-4123-a8af-7c0eb5990980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757288f5-1483-4123-a8af-7c0eb5990980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0304a48f-11f7-40b9-bca8-22db282732e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:49 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Volume 3ce3d092-858f-480f-aa76-b79654de8eec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ce3d092-858f-480f-aa76-b79654de8eec', 'volume_size': 1, 'snapshot_id': 'adc29034-424a-4daa-9a1f-ec50ca0a2a0c'} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:49 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1" returned: 0 in 0.596s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-278599698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bd67ae-833b-4492-8cfe-3671e608641b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf3f0c775d84ded9d1d0e069d380a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:48Z,use_quota=True,user_id='e9a1e9ffe3c6481e803821ffa3383914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Creating volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:49 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee8a126-6224-4bd2-a8e4-001e15b99f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ce0456-9285-49f3-a82c-9b59d3056dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:50 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b 1073741824 Apr 14 03:01:50 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:50 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Volume volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 (d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1): created successfully Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ce0456-9285-49f3-a82c-9b59d3056dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (7e471315-c291-489f-b73e-5e751ad1d999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:50 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-80e71fe6-4234-4a23-9535-af2089fcd9ad tempest-VolumesActionsTest-1583563942 None] Created volume successfully. Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Lock "cinder-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-quobyte-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Lock "cinder-quobyte-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1" acquired by "delete_volume" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c0db52-b295-42de-b57a-14eefc1086c5]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:50 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 Apr 14 03:01:50 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:50 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b 1073741824" returned: 0 in 0.580s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:50 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b Apr 14 03:01:50 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:50 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1" returned: 0 in 0.594s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:51 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1 Apr 14 03:01:51 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:51 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b" returned: 0 in 0.592s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.365s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-adc29034-424a-4daa-9a1f-ec50ca0a2a0c-3ce3d092-858f-480f-aa76-b79654de8eec" by "_create_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d73b3d7-264c-4895-80d8-186c211cd0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24bd67ae-833b-4492-8cfe-3671e608641b', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23c0788-56a0-41ff-b56b-3ed4b78674bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-adc29034-424a-4daa-9a1f-ec50ca0a2a0c-3ce3d092-858f-480f-aa76-b79654de8eec" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Creating volume 3ce3d092-858f-480f-aa76-b79654de8eec from snapshot adc29034-424a-4daa-9a1f-ec50ca0a2a0c {{(pid=82473) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-3ce3d092-858f-480f-aa76-b79654de8eec" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-3ce3d092-858f-480f-aa76-b79654de8eec" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] snapshot: adc29034-424a-4daa-9a1f-ec50ca0a2a0c, volume: 3ce3d092-858f-480f-aa76-b79654de8eec, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:01:51 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Volume volume-24bd67ae-833b-4492-8cfe-3671e608641b (24bd67ae-833b-4492-8cfe-3671e608641b): created successfully Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23c0788-56a0-41ff-b56b-3ed4b78674bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Flow 'volume_create_manager' (3f5e69b6-f31d-4b7f-a009-a1ee3eb551a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-125c59e3-82e7-49c3-a298-f8a07f837d17 tempest-SnapshotsActionsTest-1802225147 None] Created volume successfully. Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2b810f-cc66-4d81-9abe-5cab36e7fe15]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:51 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c Apr 14 03:01:51 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:51 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Lock "cinder-quobyte-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1" released by "delete_volume" :: held 1.093s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Created reservations ['9a868ca6-b796-4735-adca-db2996218f45', 'c011e3c8-be0f-426e-805a-9ae34249abb2', '3c9a3f88-e093-45b1-844c-89797a40ac55', '44418ad1-20ee-4836-9a9c-34642b20f903'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:51 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:01:51 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:51 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c" returned: 0 in 0.579s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a32e73-e06d-40c1-a9cc-0748508a642e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:51 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 Apr 14 03:01:51 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:52 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.519s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:01:52 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Deleted volume successfully. Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd92a3b5-82e6-4cde-84a8-b1f7b02b277d tempest-VolumesActionsTest-813145945 None] Lock "cinder-d8f2ffbf-0ce0-4bfa-baf7-793d36a293f1-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:52 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41" returned: 0 in 0.598s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:52 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec Apr 14 03:01:52 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (0fe27099-d1a6-432b-bbd0-b96d9db1eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3d5477-1ddd-4ac0-9ba6-c8e06395da48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3d5477-1ddd-4ac0-9ba6-c8e06395da48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1027802010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:53Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e880837-4e85-426e-ba47-995e8ceac6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e880837-4e85-426e-ba47-995e8ceac6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd150a28-e054-4f02-bcb8-3d94eeaafe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd150a28-e054-4f02-bcb8-3d94eeaafe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2', 'volume_name': 'volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c48fc99-33c1-410b-815b-bb8b9025e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c48fc99-33c1-410b-815b-bb8b9025e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b34fd3a-9024-446d-81e4-0e1b87b3793b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:52 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Volume 5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2', 'volume_size': 1} Apr 14 03:01:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:55 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec" returned: 0 in 2.809s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:55 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[03738aa9-131b-4d95-baab-1dd49ffb98dc]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:55 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 Apr 14 03:01:55 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:56 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41" returned: 0 in 0.721s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41, size 1024.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:01:56 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Converted 1024.00 MB image at 364.39 MB/s Apr 14 03:01:56 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec is being set with open permissions: ugo+rw Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:56 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec Apr 14 03:01:56 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:56 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec" returned: 0 in 0.470s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-3ce3d092-858f-480f-aa76-b79654de8eec" released by "_copy_volume_from_snapshot" :: held 5.268s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-adc29034-424a-4daa-9a1f-ec50ca0a2a0c-3ce3d092-858f-480f-aa76-b79654de8eec" released by "_create_volume_from_snapshot" :: held 5.292s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.314s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.132s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Creating offline snapshot 71ed4804-efdf-4a01-ba42-a0832be99b53 of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[34413230-a74b-4e41-91cc-11b58f8ba069]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0304a48f-11f7-40b9-bca8-22db282732e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce3d092-858f-480f-aa76-b79654de8eec', 'volume_size': 1, 'snapshot_id': 'adc29034-424a-4daa-9a1f-ec50ca0a2a0c'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a039e203-7493-47f0-98d0-32c87fea0e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:01:56 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Volume volume-3ce3d092-858f-480f-aa76-b79654de8eec (3ce3d092-858f-480f-aa76-b79654de8eec): created successfully Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a039e203-7493-47f0-98d0-32c87fea0e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:01:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Flow 'volume_create_manager' (7fe4cee3-0970-4b1b-895b-8b959ca917e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:01:56 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-613596ea-9de6-4ef3-999e-cdf2882c9568 tempest-VolumeDependencyTests-2107316729 None] Created volume successfully. Apr 14 03:01:56 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b Apr 14 03:01:56 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:57 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b" returned: 0 in 0.512s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:57 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 1G Apr 14 03:01:57 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-adc29034-424a-4daa-9a1f-ec50ca0a2a0c-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-adc29034-424a-4daa-9a1f-ec50ca0a2a0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-0ceeab25-8345-42d2-8aea-5d0b1435dd41" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-0ceeab25-8345-42d2-8aea-5d0b1435dd41" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-adc29034-424a-4daa-9a1f-ec50ca0a2a0c" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-adc29034-424a-4daa-9a1f-ec50ca0a2a0c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Deleting offline snapshot adc29034-424a-4daa-9a1f-ec50ca0a2a0c of volume 0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] snapshot_file for this snap is: volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[75837fc5-7b24-4443-aab9-41715c47eb40]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:57 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 1G" returned: 0 in 0.606s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:57 devstack sudo[85967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:01:57 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:57 devstack sudo[85966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c Apr 14 03:01:57 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:58 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:58 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:58 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 is being set with open permissions: ugo+rw Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c" returned: 0 in 0.527s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[8409786a-71e9-419b-b4ba-8de9e3fc7401]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:01:58 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:58 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:58 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 Apr 14 03:01:58 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:58 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.394s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:58 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.info Apr 14 03:01:58 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:58 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41" returned: 0 in 0.515s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:58 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c Apr 14 03:01:58 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:58 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.info" returned: 0 in 0.443s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:58 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.info is being set with open permissions: ugo+rw Apr 14 03:01:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:59 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.info Apr 14 03:01:59 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:59 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:59 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c Apr 14 03:01:59 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:59 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.info" returned: 0 in 0.420s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.921s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.485s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1027802010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:01:53Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Creating volume 5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:01:59 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:01:59 devstack sudo[85997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 1073741824 Apr 14 03:01:59 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:01:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-424f038c-5de1-43a5-8dee-9d2a95c1ed63 tempest-SnapshotsActionsTest-1802225147 None] Create snapshot completed successfully Apr 14 03:01:59 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41.adc29034-424a-4daa-9a1f-ec50ca0a2a0c" returned: 0 in 0.427s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-adc29034-424a-4daa-9a1f-ec50ca0a2a0c" released by "_delete_snapshot" :: held 1.989s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-0ceeab25-8345-42d2-8aea-5d0b1435dd41" released by "delete_snapshot" :: held 2.003s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Created reservations ['b014a5ec-b39e-4a50-a568-688e0bf689b4', 'd270beeb-d431-481f-8824-9ae5aab4e399', 'f8bb5033-921d-4c37-9fac-078519e91582', '59572086-834d-4ae0-bdbe-8c6794fafd94'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:01:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Delete snapshot completed successfully. Apr 14 03:01:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b3adbde-4f92-4432-942a-a9cb89039129 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-adc29034-424a-4daa-9a1f-ec50ca0a2a0c-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:00 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 1073741824" returned: 0 in 0.610s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:00 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 Apr 14 03:02:00 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:00 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2" returned: 0 in 0.394s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.427s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b34fd3a-9024-446d-81e4-0e1b87b3793b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228455c1-4f7c-400f-8a31-a9dbe16861ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Creating offline snapshot 480fe42d-76f3-424c-848c-54af3cc2a26b of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:02:00 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Volume volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 (5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2): created successfully Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228455c1-4f7c-400f-8a31-a9dbe16861ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (0fe27099-d1a6-432b-bbd0-b96d9db1eeef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93a871a-edcd-40a0-bc15-65cf6d491d40]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:00 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-1963996f-09ed-4a41-af5b-cabc1b9a2eef tempest-VolumesActionsTest-1583563942 None] Created volume successfully. Apr 14 03:02:00 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:00 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-0ceeab25-8345-42d2-8aea-5d0b1435dd41-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-0ceeab25-8345-42d2-8aea-5d0b1435dd41-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-0ceeab25-8345-42d2-8aea-5d0b1435dd41" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-0ceeab25-8345-42d2-8aea-5d0b1435dd41" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26f3841-fad7-4cb7-a958-495b5faa771f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:00 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 Apr 14 03:02:00 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:01 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.529s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:01 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b 1G Apr 14 03:02:01 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:01 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41" returned: 0 in 0.532s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:01 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41 Apr 14 03:02:01 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Lock "cinder-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-quobyte-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Lock "cinder-quobyte-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec991e-4621-4125-ace1-e995eb5d065b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:01 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b 1G" returned: 0 in 0.662s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:01 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 Apr 14 03:02:01 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:01 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b Apr 14 03:02:01 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:01 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ceeab25-8345-42d2-8aea-5d0b1435dd41" returned: 0 in 0.532s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-0ceeab25-8345-42d2-8aea-5d0b1435dd41" released by "delete_volume" :: held 1.100s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Created reservations ['2368e624-cd16-4ceb-99f2-7c7e98c8b770', '909ea590-fa76-421c-8af4-52a412ff7eae', '50279f9c-8ddc-46a4-a67d-f2577c9d175f', 'd9bc161e-2458-485d-9942-64bd9f46101f'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:01 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:01 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:02 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b" returned: 0 in 0.524s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:02 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b is being set with open permissions: ugo+rw Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:02 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2" returned: 0 in 0.603s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:02 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b Apr 14 03:02:02 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:02 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2 Apr 14 03:02:02 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:02 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.515s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:02 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Deleted volume successfully. Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-485b0919-15af-45d6-9a97-58358a3344b7 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-0ceeab25-8345-42d2-8aea-5d0b1435dd41-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:02 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:02 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b" returned: 0 in 0.513s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.300s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2" returned: 0 in 0.516s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Lock "cinder-quobyte-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2" released by "delete_volume" :: held 1.156s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:02 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6a617b2c-a8e7-47e2-a758-92bd581f9643 tempest-SnapshotsActionsTest-1802225147 None] Create snapshot completed successfully Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Created reservations ['05cae387-b7ff-4f73-afc6-27495617098a', '2c385891-0914-4b82-be6a-4f808c4c45a2', '60256c8e-b649-4db3-92b9-e7f8a8ba3830', 'c5797516-f573-4d44-aae3-8641c9c90534'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:02 devstack sudo[86044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:02 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Flow 'volume_create_manager' (b54571b5-6d5d-43e7-ba9b-02d524b8dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca68bed8-acae-4cbf-8666-04808f969c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca68bed8-acae-4cbf-8666-04808f969c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1291407864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8814be4d-d670-4bab-9c04-6851e4745baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e79f391dd47455291618f23ff08603a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:03Z,use_quota=True,user_id='00293de8eb28407c9ebc1a82f2d99934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9abacf-33f3-4a80-955e-10e2a7592267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9abacf-33f3-4a80-955e-10e2a7592267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622c39cc-0b3b-4464-a812-1d04253e1ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622c39cc-0b3b-4464-a812-1d04253e1ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8814be4d-d670-4bab-9c04-6851e4745baf', 'volume_name': 'volume-8814be4d-d670-4bab-9c04-6851e4745baf', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef9118d-7286-4cff-8177-52a66efcb448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ef9118d-7286-4cff-8177-52a66efcb448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ce4010-1002-4543-a224-f421d985e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:03 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Volume 8814be4d-d670-4bab-9c04-6851e4745baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8814be4d-d670-4bab-9c04-6851e4745baf', 'volume_size': 1} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1291407864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8814be4d-d670-4bab-9c04-6851e4745baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e79f391dd47455291618f23ff08603a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:03Z,use_quota=True,user_id='00293de8eb28407c9ebc1a82f2d99934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Creating volume 8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:03 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-480fe42d-76f3-424c-848c-54af3cc2a26b-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:03 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf 1073741824 Apr 14 03:02:03 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-480fe42d-76f3-424c-848c-54af3cc2a26b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-quobyte-480fe42d-76f3-424c-848c-54af3cc2a26b" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-480fe42d-76f3-424c-848c-54af3cc2a26b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Deleting offline snapshot 480fe42d-76f3-424c-848c-54af3cc2a26b of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] snapshot_file for this snap is: volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed6bb73-73f8-487a-9364-01438d133731]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:03 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.580s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:03 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Deleted volume successfully. Apr 14 03:02:03 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b Apr 14 03:02:03 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3b74b94b-61ca-43f4-be67-972fc4e5654a tempest-VolumesActionsTest-813145945 None] Lock "cinder-5501ff8b-c4f0-4b70-9bc3-5a5aa03ff0e2-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:03 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf 1073741824" returned: 0 in 0.559s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:03 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf Apr 14 03:02:03 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:03 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b" returned: 0 in 0.644s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf101037-098a-4ec4-adee-5b41965ff553]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:04 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:04 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (bec96df4-55de-4389-a4ef-cea04e70bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832d698a-a5b0-43d2-bc56-95efc64bd1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832d698a-a5b0-43d2-bc56-95efc64bd1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2047806792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4f30cc-05d9-4615-b528-187d5ba4c662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:04Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70457016-a565-4412-9abf-850f7b19b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70457016-a565-4412-9abf-850f7b19b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13abc572-270e-435b-b51c-7b132e6d61b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13abc572-270e-435b-b51c-7b132e6d61b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4f30cc-05d9-4615-b528-187d5ba4c662', 'volume_name': 'volume-7d4f30cc-05d9-4615-b528-187d5ba4c662', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1625ad5-fd7c-4999-b0a0-601028c22535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1625ad5-fd7c-4999-b0a0-601028c22535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d6185b-a777-48bc-acc6-1cd829cce396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:04 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Volume 7d4f30cc-05d9-4615-b528-187d5ba4c662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4f30cc-05d9-4615-b528-187d5ba4c662', 'volume_size': 1} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:04 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf" returned: 0 in 0.570s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2047806792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4f30cc-05d9-4615-b528-187d5ba4c662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:04Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Creating volume 7d4f30cc-05d9-4615-b528-187d5ba4c662 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:04 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:04 devstack sudo[86065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 1073741824 Apr 14 03:02:04 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ce4010-1002-4543-a224-f421d985e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8814be4d-d670-4bab-9c04-6851e4745baf', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07af21f6-ed6e-4a77-adb4-f82078b18ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:04 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Volume volume-8814be4d-d670-4bab-9c04-6851e4745baf (8814be4d-d670-4bab-9c04-6851e4745baf): created successfully Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07af21f6-ed6e-4a77-adb4-f82078b18ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Flow 'volume_create_manager' (b54571b5-6d5d-43e7-ba9b-02d524b8dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:04 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7ee9b8c1-6db0-4035-b592-4fd1b81174f3 tempest-VolumeDependencyTests-2107316729 None] Created volume successfully. Apr 14 03:02:04 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.585s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:04 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b Apr 14 03:02:04 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:05 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 1073741824" returned: 0 in 0.552s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:05 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 Apr 14 03:02:05 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:05 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b" returned: 0 in 0.590s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:05 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b Apr 14 03:02:05 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:05 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662" returned: 0 in 0.518s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d6185b-a777-48bc-acc6-1cd829cce396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4f30cc-05d9-4615-b528-187d5ba4c662', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bedaca-6dd6-44dd-a259-bb56cc59d3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:05 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Volume volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 (7d4f30cc-05d9-4615-b528-187d5ba4c662): created successfully Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bedaca-6dd6-44dd-a259-bb56cc59d3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (bec96df4-55de-4389-a4ef-cea04e70bebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:05 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8648f25a-8b35-4778-bdde-8f97c883a07f tempest-VolumesActionsTest-1583563942 None] Created volume successfully. Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:05 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Flow 'volume_create_manager' (ffd3da9f-f19e-4c0a-bf91-61d4c2669509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a72f883-290c-41db-bc66-bca67ef797fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.480fe42d-76f3-424c-848c-54af3cc2a26b" returned: 0 in 0.579s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a72f883-290c-41db-bc66-bca67ef797fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-586406713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6c9d68-a639-40b2-84ce-9f742d323bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e79f391dd47455291618f23ff08603a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8814be4d-d670-4bab-9c04-6851e4745baf,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:06Z,use_quota=True,user_id='00293de8eb28407c9ebc1a82f2d99934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680fab94-1b51-4b5d-9c81-abf8f94108d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680fab94-1b51-4b5d-9c81-abf8f94108d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6cac5f-f72c-4b4a-b00a-c653fde9607d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-480fe42d-76f3-424c-848c-54af3cc2a26b" released by "_delete_snapshot" :: held 2.476s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6cac5f-f72c-4b4a-b00a-c653fde9607d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4e6c9d68-a639-40b2-84ce-9f742d323bbb', 'volume_name': 'volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb', 'volume_size': 1, 'source_volid': '8814be4d-d670-4bab-9c04-6851e4745baf', 'source_volstatus': 'available'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1c3edf-89f9-4462-8a8b-138d78401d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1c3edf-89f9-4462-8a8b-138d78401d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c462ed-3cbb-4f3b-8f80-a35729efc46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:05 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Volume 4e6c9d68-a639-40b2-84ce-9f742d323bbb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb', 'volume_size': 1, 'source_volid': '8814be4d-d670-4bab-9c04-6851e4745baf', 'source_volstatus': 'available'} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" released by "delete_snapshot" :: held 2.523s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:05 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Cloning volume 8814be4d-d670-4bab-9c04-6851e4745baf to volume 4e6c9d68-a639-40b2-84ce-9f742d323bbb Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Creating offline snapshot 05b887a5-5990-45b7-b385-24062fb8ae90 of volume 8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Created reservations ['62bc8e55-bbd4-4810-b3dc-a11bc61ef479', 'f7f3fb45-dcd9-4b43-b185-22c579d1bb9c', '9cef58d7-ae56-4461-906c-6e68fa07989f', 'ea22e535-1f43-4847-801e-2573bc997f72'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[25efa61e-68a2-47b9-8fe7-60f371e5aa1c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:05 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Delete snapshot completed successfully. Apr 14 03:02:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e8f723ee-1dd9-48dc-bf9c-eab9afa7f247 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-480fe42d-76f3-424c-848c-54af3cc2a26b-delete_snapshot" released by "delete_snapshot" :: held 2.653s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:05 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf Apr 14 03:02:05 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-7d4f30cc-05d9-4615-b528-187d5ba4c662-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Lock "cinder-7d4f30cc-05d9-4615-b528-187d5ba4c662-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:06 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Acquiring lock "cinder-quobyte-7d4f30cc-05d9-4615-b528-187d5ba4c662" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf" returned: 0 in 0.560s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:06 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 1G Apr 14 03:02:06 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Lock "cinder-quobyte-7d4f30cc-05d9-4615-b528-187d5ba4c662" acquired by "delete_volume" :: waited 0.031s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afa3c72-e9c7-40a4-a71d-e06500977038]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:06 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 Apr 14 03:02:06 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:07 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 1G" returned: 0 in 0.562s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8814be4d-d670-4bab-9c04-6851e4745baf -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:07 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662" returned: 0 in 0.531s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:07 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8814be4d-d670-4bab-9c04-6851e4745baf -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 Apr 14 03:02:07 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:07 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662 Apr 14 03:02:07 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:07 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8814be4d-d670-4bab-9c04-6851e4745baf -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90" returned: 0 in 0.463s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:07 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 is being set with open permissions: ugo+rw Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:07 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 Apr 14 03:02:07 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:07 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-7d4f30cc-05d9-4615-b528-187d5ba4c662" returned: 0 in 0.498s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Lock "cinder-quobyte-7d4f30cc-05d9-4615-b528-187d5ba4c662" released by "delete_volume" :: held 1.058s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Created reservations ['d0515f5a-3dd8-4625-9430-1ee8ba986f77', '62ff6eee-952b-403c-9f2c-3180c7829f47', '07a6245a-c89b-4d4e-9cd9-a082aaf544b2', 'f14833aa-8b66-46b6-a1e5-b3196ff9510b'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:07 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:07 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:07 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90" returned: 0 in 0.453s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:07 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.info Apr 14 03:02:07 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:08 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.459s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:08 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Deleted volume successfully. Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98ab784f-b8c0-4607-80ea-a15f3e84cbb1 tempest-VolumesActionsTest-813145945 None] Lock "cinder-7d4f30cc-05d9-4615-b528-187d5ba4c662-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:08 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.info" returned: 0 in 0.536s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:08 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.info is being set with open permissions: ugo+rw Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:08 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.info Apr 14 03:02:08 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (c9dc70bd-30ef-4ca3-b9de-dbf669aa192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e65b101-f3d8-4e42-b5a0-3a3c07c6d84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e65b101-f3d8-4e42-b5a0-3a3c07c6d84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1612526405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f448abc6-a2ea-4048-b806-875df965ecbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:09Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176a0d5d-64b9-4e09-a8b2-817da6eb82c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176a0d5d-64b9-4e09-a8b2-817da6eb82c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c710a374-f0ec-40b6-a478-3d7ef418e429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:09 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c710a374-f0ec-40b6-a478-3d7ef418e429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f448abc6-a2ea-4048-b806-875df965ecbd', 'volume_name': 'volume-f448abc6-a2ea-4048-b806-875df965ecbd', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84cc3fe-1041-4dd1-8abf-294e071ae230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84cc3fe-1041-4dd1-8abf-294e071ae230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d844788b-cba8-448f-bd18-b68c3dc18bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:09 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Volume f448abc6-a2ea-4048-b806-875df965ecbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f448abc6-a2ea-4048-b806-875df965ecbd', 'volume_size': 1} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.info" returned: 0 in 0.539s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-4e6c9d68-a639-40b2-84ce-9f742d323bbb" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-4e6c9d68-a639-40b2-84ce-9f742d323bbb" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] snapshot: 05b887a5-5990-45b7-b385-24062fb8ae90, volume: 4e6c9d68-a639-40b2-84ce-9f742d323bbb, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb943bf-e50e-419d-85f5-f3769552d15f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:09 devstack sudo[86120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 Apr 14 03:02:09 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:09 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90" returned: 0 in 0.582s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8814be4d-d670-4bab-9c04-6851e4745baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a948a6ef-3c5e-48e9-aa5c-2deb20873b3b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:09 devstack sudo[86125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf Apr 14 03:02:09 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:10 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf" returned: 0 in 0.570s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:10 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:02:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:10 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb Apr 14 03:02:10 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:12 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb" returned: 0 in 2.170s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2208fd-a01d-403b-8465-afde5c33d636]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:12 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf Apr 14 03:02:12 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:13 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf" returned: 0 in 0.624s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:02:13 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Converted 1024.00 MB image at 471.56 MB/s Apr 14 03:02:13 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb is being set with open permissions: ugo+rw Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:13 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb Apr 14 03:02:13 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:13 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb" returned: 0 in 0.432s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-4e6c9d68-a639-40b2-84ce-9f742d323bbb" released by "_copy_volume_from_snapshot" :: held 4.429s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-05b887a5-5990-45b7-b385-24062fb8ae90" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-05b887a5-5990-45b7-b385-24062fb8ae90" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Deleting offline snapshot 05b887a5-5990-45b7-b385-24062fb8ae90 of volume 8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] snapshot_file for this snap is: volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[812b7859-1d93-4f5e-842b-8d757bb1039b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:13 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 Apr 14 03:02:13 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:13 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8814be4d-d670-4bab-9c04-6851e4745baf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ab46f2-e6d9-4add-8563-f334d9ad8b09]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:14 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf Apr 14 03:02:14 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:14 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf" returned: 0 in 0.464s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:14 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 Apr 14 03:02:14 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:14 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:14 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:14 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90" returned: 0 in 0.460s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:14 devstack sudo[86170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90 Apr 14 03:02:14 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:15 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.450s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:15 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf.05b887a5-5990-45b7-b385-24062fb8ae90" returned: 0 in 0.442s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-05b887a5-5990-45b7-b385-24062fb8ae90" released by "_delete_snapshot" :: held 1.894s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.582s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.723s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Creating offline snapshot 85ed2df3-e649-488d-a0fc-b47a648aae4d of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c462ed-3cbb-4f3b-8f80-a35729efc46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb', 'volume_size': 1, 'source_volid': '8814be4d-d670-4bab-9c04-6851e4745baf', 'source_volstatus': 'available'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eab0634-3abd-4361-881f-eb8e92ce9c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbaa2c3-ae1f-4bff-b140-73a38345fb71]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:15 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Volume volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb (4e6c9d68-a639-40b2-84ce-9f742d323bbb): created successfully Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eab0634-3abd-4361-881f-eb8e92ce9c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Flow 'volume_create_manager' (ffd3da9f-f19e-4c0a-bf91-61d4c2669509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:15 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-046301dc-4199-4d60-823e-dd098134297c tempest-VolumeDependencyTests-2107316729 None] Created volume successfully. Apr 14 03:02:15 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:15 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:15 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.481s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:15 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d 1G Apr 14 03:02:15 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-8814be4d-d670-4bab-9c04-6851e4745baf-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-8814be4d-d670-4bab-9c04-6851e4745baf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-8814be4d-d670-4bab-9c04-6851e4745baf" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-8814be4d-d670-4bab-9c04-6851e4745baf" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f669d9-271a-4321-91dd-3d75c41859f0]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:16 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d 1G" returned: 0 in 0.575s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:16 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d Apr 14 03:02:16 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:16 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf Apr 14 03:02:16 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:16 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d" returned: 0 in 0.441s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:16 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d is being set with open permissions: ugo+rw Apr 14 03:02:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:16 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d Apr 14 03:02:16 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:17 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf" returned: 0 in 0.511s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:17 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf Apr 14 03:02:17 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:17 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d" returned: 0 in 0.446s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.397s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1612526405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f448abc6-a2ea-4048-b806-875df965ecbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8918ae2976654cc593061054d4dff004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:09Z,use_quota=True,user_id='830e13103ddf4f06a02b6e00a43e4d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Creating volume f448abc6-a2ea-4048-b806-875df965ecbd {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:17 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:17 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd 1073741824 Apr 14 03:02:17 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:17 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6c45cdbc-a3a9-4205-8edd-f2331e4cfb4a tempest-SnapshotsActionsTest-1802225147 None] Create snapshot completed successfully Apr 14 03:02:17 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8814be4d-d670-4bab-9c04-6851e4745baf" returned: 0 in 0.530s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-8814be4d-d670-4bab-9c04-6851e4745baf" released by "delete_volume" :: held 1.068s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Created reservations ['68b1f85c-ca9d-4466-b497-52f0f6d6e0ad', '111547bf-e406-4866-ade0-433c9792c846', '9b8d376b-7a61-44d5-97fa-85a6f1fc1225', '36d11d8f-a3aa-4490-9022-344fbc9a9f7b'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:17 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:17 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:17 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd 1073741824" returned: 0 in 0.530s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:18 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd Apr 14 03:02:18 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:18 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.462s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:18 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Deleted volume successfully. Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b72f3e3f-8d91-4781-94bb-b198e71b6ee7 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-8814be4d-d670-4bab-9c04-6851e4745baf-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-85ed2df3-e649-488d-a0fc-b47a648aae4d-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-85ed2df3-e649-488d-a0fc-b47a648aae4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-quobyte-85ed2df3-e649-488d-a0fc-b47a648aae4d" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-85ed2df3-e649-488d-a0fc-b47a648aae4d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Deleting offline snapshot 85ed2df3-e649-488d-a0fc-b47a648aae4d of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] snapshot_file for this snap is: volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5578ace1-2586-4a68-826f-c4653df84a17]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:18 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d Apr 14 03:02:18 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:18 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd" returned: 0 in 0.546s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d844788b-cba8-448f-bd18-b68c3dc18bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f448abc6-a2ea-4048-b806-875df965ecbd', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b85d41a-3f0c-4db1-9536-074af3ce2d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:18 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Volume volume-f448abc6-a2ea-4048-b806-875df965ecbd (f448abc6-a2ea-4048-b806-875df965ecbd): created successfully Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b85d41a-3f0c-4db1-9536-074af3ce2d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Flow 'volume_create_manager' (c9dc70bd-30ef-4ca3-b9de-dbf669aa192d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:18 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-48727393-1e5f-40c6-9880-901fb8a399bc tempest-VolumesActionsTest-1583563942 None] Created volume successfully. Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-4e6c9d68-a639-40b2-84ce-9f742d323bbb-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-4e6c9d68-a639-40b2-84ce-9f742d323bbb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-4e6c9d68-a639-40b2-84ce-9f742d323bbb" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-4e6c9d68-a639-40b2-84ce-9f742d323bbb" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b4b263-7c42-4a03-b258-38ccd0857168]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:18 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb Apr 14 03:02:18 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:18 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d" returned: 0 in 0.611s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15fdb2e-635a-406c-81e7-4dc7778ba0ed]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:18 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:18 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:19 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb" returned: 0 in 0.486s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:19 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb Apr 14 03:02:19 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:19 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:19 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d Apr 14 03:02:19 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:19 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4e6c9d68-a639-40b2-84ce-9f742d323bbb" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-4e6c9d68-a639-40b2-84ce-9f742d323bbb" released by "delete_volume" :: held 0.979s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Created reservations ['7ccf0c82-b967-4b90-abcf-b2f927a3f371', '03c64b39-7fa4-4ae0-8eaf-2b8f00929b9f', '928c1f9f-666e-47d1-b7f1-8e312077809f', 'b04470e3-35d2-4a43-bdf3-00ca05a1944a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:19 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:19 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:19 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d" returned: 0 in 0.578s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:19 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d Apr 14 03:02:19 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Acquiring lock "cinder-f448abc6-a2ea-4048-b806-875df965ecbd-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Lock "cinder-f448abc6-a2ea-4048-b806-875df965ecbd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Acquiring lock "cinder-quobyte-f448abc6-a2ea-4048-b806-875df965ecbd" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Lock "cinder-quobyte-f448abc6-a2ea-4048-b806-875df965ecbd" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d7e1dd-0d4c-4d4b-8b02-00a7a5354aa4]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:20 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd Apr 14 03:02:20 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:20 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.441s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:20 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Deleted volume successfully. Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bb7f7d89-821f-4a87-8389-eb3e6ccf8639 tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-4e6c9d68-a639-40b2-84ce-9f742d323bbb-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:20 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.85ed2df3-e649-488d-a0fc-b47a648aae4d" returned: 0 in 0.458s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-85ed2df3-e649-488d-a0fc-b47a648aae4d" released by "_delete_snapshot" :: held 2.175s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" released by "delete_snapshot" :: held 2.189s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Created reservations ['57cd9496-d857-4ccf-99cf-879982953caa', 'acd71bcd-3579-49d4-8ae5-27c3b1923003', 'ca6209f3-e8fe-4435-baa7-034f8e4e51db', 'e4d45d5d-25cb-44b0-8ca6-840d1772ffc7'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:20 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Delete snapshot completed successfully. Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-98a91b58-00bb-4809-8608-36a12d288a7c tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-85ed2df3-e649-488d-a0fc-b47a648aae4d-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:20 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd" returned: 0 in 0.489s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:20 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd Apr 14 03:02:20 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-3ce3d092-858f-480f-aa76-b79654de8eec-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-3ce3d092-858f-480f-aa76-b79654de8eec-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "cinder-quobyte-3ce3d092-858f-480f-aa76-b79654de8eec" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-3ce3d092-858f-480f-aa76-b79654de8eec" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5830c3-9bc8-43c5-97bb-2f48b98d6934]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:20 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec Apr 14 03:02:20 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:21 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f448abc6-a2ea-4048-b806-875df965ecbd" returned: 0 in 0.448s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Lock "cinder-quobyte-f448abc6-a2ea-4048-b806-875df965ecbd" released by "delete_volume" :: held 0.958s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Created reservations ['0e41efa4-63f1-4629-8f67-bc17ac4afd90', '4e46ff3c-1a6f-4fe5-9624-09749f46a588', 'd138970a-5b44-41cc-9021-04e02e08006f', 'bd6a4698-4fe0-4d23-ae3e-cd992e300d3e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:21 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:21 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:21 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec" returned: 0 in 0.550s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:21 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec Apr 14 03:02:21 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Creating offline snapshot 50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c4d5ee-594c-452b-ac8e-96e0bb688f10]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:21 devstack sudo[86274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:21 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:21 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.635s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:21 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Deleted volume successfully. Apr 14 03:02:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c924b47a-4998-430d-a657-0c6e84e4512d tempest-VolumesActionsTest-1583563942 None] Lock "cinder-f448abc6-a2ea-4048-b806-875df965ecbd-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:22 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3ce3d092-858f-480f-aa76-b79654de8eec" returned: 0 in 0.534s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-quobyte-3ce3d092-858f-480f-aa76-b79654de8eec" released by "delete_volume" :: held 1.105s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Created reservations ['1361863c-c98b-423b-a80e-bdd92d561294', '11c3a721-4f47-4971-8a45-3c9e9ec9ce67', '2e707d04-c2c4-4652-bdea-480c13229e9d', '0e724a9e-3207-4a25-9dee-d017559a2ded'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:22 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:22 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:22 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.649s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:22 devstack sudo[86287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 1G Apr 14 03:02:22 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:22 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.461s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:22 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Deleted volume successfully. Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6d7848fe-f9c8-4d6c-b3b9-9676a30a98ea tempest-VolumeDependencyTests-2107316729 None] Lock "cinder-3ce3d092-858f-480f-aa76-b79654de8eec-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:22 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 1G" returned: 0 in 0.532s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:22 devstack sudo[86293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 Apr 14 03:02:22 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:23 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1" returned: 0 in 0.689s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:23 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 is being set with open permissions: ugo+rw Apr 14 03:02:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:23 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 Apr 14 03:02:23 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:24 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1" returned: 0 in 0.531s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7c5ab237-21be-4250-8ddf-3d96d54875bf tempest-SnapshotsActionsTest-1802225147 None] Create snapshot completed successfully Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-50a1e307-b140-4f7d-9d66-d09c0a0dd3b1-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-50a1e307-b140-4f7d-9d66-d09c0a0dd3b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-quobyte-50a1e307-b140-4f7d-9d66-d09c0a0dd3b1" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-50a1e307-b140-4f7d-9d66-d09c0a0dd3b1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Deleting offline snapshot 50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] snapshot_file for this snap is: volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[420369dc-58f0-449c-b718-8ae28f4bf858]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:25 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 Apr 14 03:02:25 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:25 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1" returned: 0 in 0.576s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:25 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4176eab3-4283-48a1-b952-9334880ae498]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:25 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:25 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:26 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.566s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:26 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 Apr 14 03:02:26 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:26 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1" returned: 0 in 0.676s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:26 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1 Apr 14 03:02:26 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:27 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.50a1e307-b140-4f7d-9d66-d09c0a0dd3b1" returned: 0 in 0.536s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-50a1e307-b140-4f7d-9d66-d09c0a0dd3b1" released by "_delete_snapshot" :: held 2.416s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" released by "delete_snapshot" :: held 2.428s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:27 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Created reservations ['754a892c-f430-4295-ac10-61d83817d3b6', '53225bbe-c331-4723-a252-9561c74b9d2e', 'c5ab0b2c-16a3-4e69-be4a-0d14191d9084', '85e3c115-e6e0-4995-a5b7-ee7289f4abf0'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Delete snapshot completed successfully. Apr 14 03:02:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ad2a7a5-53fc-4dc6-b611-7e5b7c19802d tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-50a1e307-b140-4f7d-9d66-d09c0a0dd3b1-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Creating offline snapshot 7477fb1a-0dea-419c-a7bc-85a97df17500 of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:02:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1f9b55-0984-4aca-b302-5b0b9808026d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:28 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:28 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:29 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.671s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:29 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 1G Apr 14 03:02:29 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:29 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 1G" returned: 0 in 0.623s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:29 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 Apr 14 03:02:29 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:30 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500" returned: 0 in 0.541s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:30 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 is being set with open permissions: ugo+rw Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:30 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 Apr 14 03:02:30 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Flow 'volume_create_manager' (0d30d718-cab7-45e6-b825-2607ad699728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4f6e15-4ab6-46b8-8b83-48d58616a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4f6e15-4ab6-46b8-8b83-48d58616a6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1731680323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8990768c-1c7c-44f3-ba45-3d9932eec920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81acb33d003c4bc8bbd2f82b3e453cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:31Z,use_quota=True,user_id='670447f8ab4548ba8dee4ee854663df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c2ba88-6e04-4f4c-9562-02d0372aeb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c2ba88-6e04-4f4c-9562-02d0372aeb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af59e35c-e8a1-464a-a1cc-051d6026a026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af59e35c-e8a1-464a-a1cc-051d6026a026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8990768c-1c7c-44f3-ba45-3d9932eec920', 'volume_name': 'volume-8990768c-1c7c-44f3-ba45-3d9932eec920', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5843a39-85bc-46c5-a8dd-9ef9ec1e24b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5843a39-85bc-46c5-a8dd-9ef9ec1e24b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2a7164-54c0-41ae-ae57-86f3e87b4e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:30 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Volume 8990768c-1c7c-44f3-ba45-3d9932eec920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8990768c-1c7c-44f3-ba45-3d9932eec920', 'volume_size': 1} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:30 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500" returned: 0 in 0.514s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1731680323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8990768c-1c7c-44f3-ba45-3d9932eec920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81acb33d003c4bc8bbd2f82b3e453cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:31Z,use_quota=True,user_id='670447f8ab4548ba8dee4ee854663df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Creating volume 8990768c-1c7c-44f3-ba45-3d9932eec920 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:30 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:30 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 1073741824 Apr 14 03:02:30 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:30 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f25e043d-559c-4ebd-b5e4-fd97e3e862f9 tempest-SnapshotsActionsTest-1802225147 None] Create snapshot completed successfully Apr 14 03:02:31 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 1073741824" returned: 0 in 0.543s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:31 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 Apr 14 03:02:31 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-7477fb1a-0dea-419c-a7bc-85a97df17500-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-7477fb1a-0dea-419c-a7bc-85a97df17500-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Acquiring lock "cinder-quobyte-7477fb1a-0dea-419c-a7bc-85a97df17500" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-7477fb1a-0dea-419c-a7bc-85a97df17500" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Deleting offline snapshot 7477fb1a-0dea-419c-a7bc-85a97df17500 of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] snapshot_file for this snap is: volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a0968-8078-4b0d-8d87-9e5ab7eaaa50]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:31 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 Apr 14 03:02:31 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:32 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920" returned: 0 in 0.687s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2a7164-54c0-41ae-ae57-86f3e87b4e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8990768c-1c7c-44f3-ba45-3d9932eec920', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e105c2-1df4-4abd-bd88-b1d645bccc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:32 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Volume volume-8990768c-1c7c-44f3-ba45-3d9932eec920 (8990768c-1c7c-44f3-ba45-3d9932eec920): created successfully Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e105c2-1df4-4abd-bd88-b1d645bccc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Flow 'volume_create_manager' (0d30d718-cab7-45e6-b825-2607ad699728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a2295dad-4cd2-4cfe-80cc-be4790abe20f tempest-VolumesListAdminTestJSON-1369720416 None] Created volume successfully. Apr 14 03:02:32 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500" returned: 0 in 0.542s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c4729-541b-41f0-b4f5-cf16d139dae2]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:32 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:32 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:32 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.634s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:32 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 Apr 14 03:02:32 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Flow 'volume_create_manager' (11055359-39f8-48c9-b214-79e2add7ac4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6006325-df85-4c63-add5-bce6be59172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6006325-df85-4c63-add5-bce6be59172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-269843599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81acb33d003c4bc8bbd2f82b3e453cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:33Z,use_quota=True,user_id='670447f8ab4548ba8dee4ee854663df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0459cd03-8b2e-4b32-9f99-972e25b7c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0459cd03-8b2e-4b32-9f99-972e25b7c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8241ed99-4b3b-4fb6-979c-b25adacce7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8241ed99-4b3b-4fb6-979c-b25adacce7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e', 'volume_name': 'volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259cf69-6db5-4514-8339-7555eec836b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259cf69-6db5-4514-8339-7555eec836b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55814bd-8c44-468a-984c-69473e1cb122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:33 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Volume 80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e', 'volume_size': 1} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-269843599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81acb33d003c4bc8bbd2f82b3e453cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:33Z,use_quota=True,user_id='670447f8ab4548ba8dee4ee854663df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Creating volume 80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:33 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:33 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e 1073741824 Apr 14 03:02:33 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:33 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500" returned: 0 in 0.570s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:33 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500 Apr 14 03:02:33 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:33 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e 1073741824" returned: 0 in 0.667s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:33 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e Apr 14 03:02:33 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:34 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.7477fb1a-0dea-419c-a7bc-85a97df17500" returned: 0 in 0.578s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-7477fb1a-0dea-419c-a7bc-85a97df17500" released by "_delete_snapshot" :: held 2.410s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" released by "delete_snapshot" :: held 2.425s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Created reservations ['6fdd8421-7f0d-41b3-a83c-21144b0ac571', '77b93bbc-8d9c-4226-920b-39df82df0395', '8b7edba3-c49e-4b28-ad15-73042d15aa45', '1fa3e3af-d634-4c45-beea-35d42e02b12c'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:34 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Delete snapshot completed successfully. Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f47fe3a5-de58-4cde-adfa-e3bf00529c57 tempest-SnapshotsActionsTest-614692078 None] Lock "cinder-7477fb1a-0dea-419c-a7bc-85a97df17500-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:34 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e" returned: 0 in 0.441s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55814bd-8c44-468a-984c-69473e1cb122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65955cd1-74bd-44e5-880b-82caa4383817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:34 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Volume volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e (80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e): created successfully Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65955cd1-74bd-44e5-880b-82caa4383817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Flow 'volume_create_manager' (11055359-39f8-48c9-b214-79e2add7ac4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:34 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-702165e1-f701-45ff-a7d1-579c41b622c4 tempest-VolumesListAdminTestJSON-1369720416 None] Created volume successfully. Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "cinder-71ed4804-efdf-4a01-ba42-a0832be99b53-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-71ed4804-efdf-4a01-ba42-a0832be99b53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "cinder-quobyte-71ed4804-efdf-4a01-ba42-a0832be99b53" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-quobyte-71ed4804-efdf-4a01-ba42-a0832be99b53" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Deleting offline snapshot 71ed4804-efdf-4a01-ba42-a0832be99b53 of volume 24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] snapshot_file for this snap is: volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9add3a-0a9d-4635-b03d-2ae72258e8bc]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:35 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:35 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Flow 'volume_create_manager' (5968e6a7-ee84-458c-ac2b-b5321d3d4274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16544243-07d8-4f38-a2a1-0e25163543c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16544243-07d8-4f38-a2a1-0e25163543c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2113252037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60630e6-38fb-4e84-9758-1cb9def0c5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81acb33d003c4bc8bbd2f82b3e453cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:36Z,use_quota=True,user_id='670447f8ab4548ba8dee4ee854663df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473df824-e610-4336-bf39-359dd8f5b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473df824-e610-4336-bf39-359dd8f5b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afedb51-0984-4c20-9c41-ccf74a4670e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afedb51-0984-4c20-9c41-ccf74a4670e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60630e6-38fb-4e84-9758-1cb9def0c5b6', 'volume_name': 'volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d89ec9c-72af-4bae-abfa-72d2b5b089c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d89ec9c-72af-4bae-abfa-72d2b5b089c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d088ef9e-47c9-41f5-8ebb-b0d8901818a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:35 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Volume f60630e6-38fb-4e84-9758-1cb9def0c5b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6', 'volume_size': 1} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2113252037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60630e6-38fb-4e84-9758-1cb9def0c5b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81acb33d003c4bc8bbd2f82b3e453cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:36Z,use_quota=True,user_id='670447f8ab4548ba8dee4ee854663df4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Creating volume f60630e6-38fb-4e84-9758-1cb9def0c5b6 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:35 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:35 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 1073741824 Apr 14 03:02:35 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:35 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.638s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bd67ae-833b-4492-8cfe-3671e608641b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3519b2a0-0149-4e21-9615-d3b994a47d41]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:35 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b Apr 14 03:02:35 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:36 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 1073741824" returned: 0 in 0.581s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:36 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 Apr 14 03:02:36 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:36 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b" returned: 0 in 0.521s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:36 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:36 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:36 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6" returned: 0 in 0.504s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d088ef9e-47c9-41f5-8ebb-b0d8901818a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55480d16-3976-4e13-91fc-4e974ac83e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:36 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.484s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:36 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Volume volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 (f60630e6-38fb-4e84-9758-1cb9def0c5b6): created successfully Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55480d16-3976-4e13-91fc-4e974ac83e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:36 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53 Apr 14 03:02:36 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Flow 'volume_create_manager' (5968e6a7-ee84-458c-ac2b-b5321d3d4274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:36 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-480b78cf-47ff-4d4d-a5ff-e01a1fac4ac1 tempest-VolumesListAdminTestJSON-1369720416 None] Created volume successfully. Apr 14 03:02:37 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b.71ed4804-efdf-4a01-ba42-a0832be99b53" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-quobyte-71ed4804-efdf-4a01-ba42-a0832be99b53" released by "_delete_snapshot" :: held 2.124s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" released by "delete_snapshot" :: held 2.143s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:37 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Created reservations ['d2791e73-654c-45ef-927d-74721b55f7e7', '660a9011-a88a-4262-8c23-43b03659b2fb', '82755a42-6120-4820-a3da-b68908eee5ce', '8987c1a8-2613-407e-83b4-efa017f8805c'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:37 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Delete snapshot completed successfully. Apr 14 03:02:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-313e9b76-1193-4adb-89aa-1da5e60b9a06 tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-71ed4804-efdf-4a01-ba42-a0832be99b53-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Flow 'volume_create_manager' (d535500b-365f-4021-831b-eee9dede2bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e2765a-4fc7-4185-8655-0c6764a84b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e2765a-4fc7-4185-8655-0c6764a84b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0622a38f-4dc8-4626-b254-ef660787d561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72067cf3ae704ad3ba648b27f1ab2bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:38Z,use_quota=True,user_id='50574f92a3614f0283c93b0c8bc07902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f78d1b-6fb9-4ec6-832f-c42bc734fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f78d1b-6fb9-4ec6-832f-c42bc734fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aff50f4-1968-4b63-a443-c2b9f22e3eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aff50f4-1968-4b63-a443-c2b9f22e3eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0622a38f-4dc8-4626-b254-ef660787d561', 'volume_name': 'volume-0622a38f-4dc8-4626-b254-ef660787d561', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8937e2-b3f3-4068-b5f1-6ecc5c86f5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8937e2-b3f3-4068-b5f1-6ecc5c86f5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e9c30b-6b4f-469a-ad81-cc487bec6cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:38 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Volume 0622a38f-4dc8-4626-b254-ef660787d561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0622a38f-4dc8-4626-b254-ef660787d561', 'volume_size': 1} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0622a38f-4dc8-4626-b254-ef660787d561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72067cf3ae704ad3ba648b27f1ab2bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:38Z,use_quota=True,user_id='50574f92a3614f0283c93b0c8bc07902',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Creating volume 0622a38f-4dc8-4626-b254-ef660787d561 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:38 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:38 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 1073741824 Apr 14 03:02:38 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "cinder-24bd67ae-833b-4492-8cfe-3671e608641b-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-24bd67ae-833b-4492-8cfe-3671e608641b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" acquired by "delete_volume" :: waited 0.023s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b63ab-af4b-40f2-8d0a-4316ff2d010d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:38 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b Apr 14 03:02:38 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:39 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 1073741824" returned: 0 in 1.092s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:39 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 Apr 14 03:02:39 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:39 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b" returned: 0 in 0.784s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:39 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b Apr 14 03:02:39 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:39 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561" returned: 0 in 0.591s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e9c30b-6b4f-469a-ad81-cc487bec6cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0622a38f-4dc8-4626-b254-ef660787d561', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f31a020-6716-4f42-8ef9-e0a716ae11f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:39 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Volume volume-0622a38f-4dc8-4626-b254-ef660787d561 (0622a38f-4dc8-4626-b254-ef660787d561): created successfully Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f31a020-6716-4f42-8ef9-e0a716ae11f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:39 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Flow 'volume_create_manager' (d535500b-365f-4021-831b-eee9dede2bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-24bd67ae-833b-4492-8cfe-3671e608641b" returned: 0 in 0.575s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:39 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-2f8007ed-3aa5-4ebc-b551-0f76dcad6c78 tempest-VolumesListAdminTestJSON-403538217 None] Created volume successfully. Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-quobyte-24bd67ae-833b-4492-8cfe-3671e608641b" released by "delete_volume" :: held 1.443s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:39 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Created reservations ['fd7b3860-1496-4ae2-8a06-a603dab8a9cb', '0fa4ddac-fef0-4186-9133-60722c3cd084', '05e50c34-fe5d-4c0d-9728-7edcec94fcc4', '96f91c73-e2b6-4ece-ab95-132c01c6fd75'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:40 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:40 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Acquiring lock "cinder-0622a38f-4dc8-4626-b254-ef660787d561-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Lock "cinder-0622a38f-4dc8-4626-b254-ef660787d561-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Acquiring lock "cinder-quobyte-0622a38f-4dc8-4626-b254-ef660787d561" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Lock "cinder-quobyte-0622a38f-4dc8-4626-b254-ef660787d561" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a152d964-ceb4-4e1a-92a0-4f6c8db1a4ff]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "cinder-f60630e6-38fb-4e84-9758-1cb9def0c5b6-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-f60630e6-38fb-4e84-9758-1cb9def0c5b6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "cinder-quobyte-f60630e6-38fb-4e84-9758-1cb9def0c5b6" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-quobyte-f60630e6-38fb-4e84-9758-1cb9def0c5b6" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ddc325-75bf-4264-9439-ca0af0e37fe6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:40 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 Apr 14 03:02:40 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:40 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 Apr 14 03:02:40 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:40 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.661s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:40 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Deleted volume successfully. Apr 14 03:02:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-aebf81c0-b79c-4bcc-853d-c428988c859a tempest-SnapshotsActionsTest-1802225147 None] Lock "cinder-24bd67ae-833b-4492-8cfe-3671e608641b-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:41 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6" returned: 0 in 0.888s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:41 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561" returned: 0 in 1.021s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:41 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6 Apr 14 03:02:41 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:41 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561 Apr 14 03:02:41 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:42 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f60630e6-38fb-4e84-9758-1cb9def0c5b6" returned: 0 in 0.654s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-quobyte-f60630e6-38fb-4e84-9758-1cb9def0c5b6" released by "delete_volume" :: held 1.579s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Created reservations ['83a533c3-15e4-4700-b8c1-4e5deb67e22f', '29d9ff20-cbd9-4f16-a985-0cb0cae28fb0', '5b7ab105-3700-4c56-ac3b-14b50342d3f5', 'b9119555-1521-4f19-989d-ecc72fec94f7'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:42 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0622a38f-4dc8-4626-b254-ef660787d561" returned: 0 in 0.802s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:42 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:42 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Lock "cinder-quobyte-0622a38f-4dc8-4626-b254-ef660787d561" released by "delete_volume" :: held 1.886s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Created reservations ['0d7c34b1-9d0e-4785-97ca-981f97297692', '5f884235-f307-4777-a34d-c5353c1a756e', '7dcda413-73fe-4e7f-ad07-da9db6f4e486', 'ae9ed236-8b96-45e7-92dc-6254a280d995'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:42 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:42 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "cinder-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:42 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.790s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "cinder-quobyte-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:43 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Deleted volume successfully. Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-quobyte-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e" acquired by "delete_volume" :: waited 0.019s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5dcf795f-cdf6-4ba2-997f-02d09ae42810 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-f60630e6-38fb-4e84-9758-1cb9def0c5b6-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d29778a-02b5-4a96-b79c-8095fa1fff0a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:43 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.818s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:43 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Deleted volume successfully. Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:UPDATE=185,cinder:DELETE=24,cinder:SELECT=132,cinder:INSERT=42 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:02:43 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d2c344b-2c8e-447e-864b-9d1e779d0914 tempest-VolumesListAdminTestJSON-403538217 None] Lock "cinder-0622a38f-4dc8-4626-b254-ef660787d561-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:43 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:43 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e" returned: 0 in 0.629s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:43 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e Apr 14 03:02:43 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:44 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e" returned: 0 in 0.520s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-quobyte-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e" released by "delete_volume" :: held 1.187s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=147,cinder:INSERT=49,cinder:UPDATE=178,cinder:DELETE=9 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Created reservations ['72a9af3a-5fae-408d-ac69-c6b79bc9176f', '88963d0b-d70e-4413-a24b-ea68ec6218ed', 'b5e72246-5f4b-493b-9ccd-45ec2202a45a', '8e54f050-c391-4cbe-a177-1b13874b4fc2'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:44 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:44 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:44 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.475s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:44 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Deleted volume successfully. Apr 14 03:02:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-be05c1db-1d4e-445b-94b0-8ebe1b1458a4 tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-80d2cc0f-b9a4-4ee1-b57d-8f3d5e48ec2e-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "cinder-8990768c-1c7c-44f3-ba45-3d9932eec920-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-8990768c-1c7c-44f3-ba45-3d9932eec920-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "cinder-quobyte-8990768c-1c7c-44f3-ba45-3d9932eec920" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-quobyte-8990768c-1c7c-44f3-ba45-3d9932eec920" acquired by "delete_volume" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:45 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9708d2-e0e7-493d-ba52-9377420b891d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:45 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 Apr 14 03:02:45 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:45 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920" returned: 0 in 0.607s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:45 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920 Apr 14 03:02:45 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Flow 'volume_create_manager' (aa43f96a-2aaa-4a6a-978b-f464fbb81aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929e1c3f-a7d0-47e8-ac3d-78a696c2dec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929e1c3f-a7d0-47e8-ac3d-78a696c2dec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-471387690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09957a8f-d894-4a3d-987b-d94031ab01c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a9c5a93f4946dfa3e73bced76b7249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:46Z,use_quota=True,user_id='8638bf56ed86436c8c7cdc65a0318ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf357e4c-56cb-4da8-8e48-605f0a3e919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf357e4c-56cb-4da8-8e48-605f0a3e919d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b01945a-e37a-449a-9b86-3f1c3cfa5303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b01945a-e37a-449a-9b86-3f1c3cfa5303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09957a8f-d894-4a3d-987b-d94031ab01c3', 'volume_name': 'volume-09957a8f-d894-4a3d-987b-d94031ab01c3', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25f357a-249f-455d-97f2-9fdb68eaae5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25f357a-249f-455d-97f2-9fdb68eaae5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90eaff0e-25f2-489b-8b60-77cb90410adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:46 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Volume 09957a8f-d894-4a3d-987b-d94031ab01c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09957a8f-d894-4a3d-987b-d94031ab01c3', 'volume_size': 1} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-471387690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09957a8f-d894-4a3d-987b-d94031ab01c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a9c5a93f4946dfa3e73bced76b7249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:46Z,use_quota=True,user_id='8638bf56ed86436c8c7cdc65a0318ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Creating volume 09957a8f-d894-4a3d-987b-d94031ab01c3 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:46 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:46 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 1073741824 Apr 14 03:02:46 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:46 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8990768c-1c7c-44f3-ba45-3d9932eec920" returned: 0 in 0.461s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-quobyte-8990768c-1c7c-44f3-ba45-3d9932eec920" released by "delete_volume" :: held 1.100s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Created reservations ['b99bea98-fe03-4e57-ac4d-ebf069e490b6', 'bc01ab41-0e9e-451c-b467-27e744973b6a', 'a87d8f83-3490-44c5-b7d5-d65554263c17', '932adb2c-62a1-456c-9540-99287fde410a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:46 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:46 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:46 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 1073741824" returned: 0 in 0.596s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:46 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 Apr 14 03:02:46 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:47 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.557s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:47 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Deleted volume successfully. Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fcc6eb2d-f4da-41a8-8188-00911377629c tempest-VolumesListAdminTestJSON-1369720416 None] Lock "cinder-8990768c-1c7c-44f3-ba45-3d9932eec920-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:47 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3" returned: 0 in 0.616s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90eaff0e-25f2-489b-8b60-77cb90410adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09957a8f-d894-4a3d-987b-d94031ab01c3', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215d6c51-61d9-495c-a7cd-614f2d975ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:47 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Volume volume-09957a8f-d894-4a3d-987b-d94031ab01c3 (09957a8f-d894-4a3d-987b-d94031ab01c3): created successfully Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215d6c51-61d9-495c-a7cd-614f2d975ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Flow 'volume_create_manager' (aa43f96a-2aaa-4a6a-978b-f464fbb81aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:47 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f2507381-e085-42d5-be8d-89132a3df03f tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Created volume successfully. Apr 14 03:02:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Creating offline snapshot 0c3245a2-8477-473a-b07a-a048e0c347dc of volume 09957a8f-d894-4a3d-987b-d94031ab01c3 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:02:48 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c27a1b8-12f8-4eda-935b-d02e9e1204b3]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:48 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 Apr 14 03:02:48 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:48 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3" returned: 0 in 0.627s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:49 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc 1G Apr 14 03:02:49 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Flow 'volume_create_manager' (730fe999-5576-462c-98cd-bb91f4b0b3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bbb937-9b0b-43e8-8465-7134f61ecf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bbb937-9b0b-43e8-8465-7134f61ecf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-347511484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb275b2d-bdf4-4948-9815-adb820df5329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ccaa9d08854eb28598f1de49259148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:49Z,use_quota=True,user_id='4d6f5df0a5ba4590ba8d1cf0edd67cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab88fe5-cafb-4f28-9c39-41db4ba15f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab88fe5-cafb-4f28-9c39-41db4ba15f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5672e96-7208-4e7c-a00f-61a61f09925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5672e96-7208-4e7c-a00f-61a61f09925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb275b2d-bdf4-4948-9815-adb820df5329', 'volume_name': 'volume-fb275b2d-bdf4-4948-9815-adb820df5329', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1da848-5619-41a0-a94f-bd322458be13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1da848-5619-41a0-a94f-bd322458be13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f0213c-c7bb-4eae-b41e-f1103c4ecb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:49 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Volume fb275b2d-bdf4-4948-9815-adb820df5329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb275b2d-bdf4-4948-9815-adb820df5329', 'volume_size': 1} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:49 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc 1G" returned: 0 in 0.642s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09957a8f-d894-4a3d-987b-d94031ab01c3 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:49 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09957a8f-d894-4a3d-987b-d94031ab01c3 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc Apr 14 03:02:49 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:50 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09957a8f-d894-4a3d-987b-d94031ab01c3 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc" returned: 0 in 0.500s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:50 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc is being set with open permissions: ugo+rw Apr 14 03:02:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:50 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc Apr 14 03:02:50 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:50 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:50 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.info Apr 14 03:02:50 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:51 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.info" returned: 0 in 0.461s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:51 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.info is being set with open permissions: ugo+rw Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:51 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.info Apr 14 03:02:51 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:51 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.info" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.243s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-347511484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb275b2d-bdf4-4948-9815-adb820df5329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ccaa9d08854eb28598f1de49259148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:49Z,use_quota=True,user_id='4d6f5df0a5ba4590ba8d1cf0edd67cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Creating volume fb275b2d-bdf4-4948-9815-adb820df5329 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:51 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:51 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 1073741824 Apr 14 03:02:51 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-91cbbdf8-9c14-456d-b596-3c74e0b791dd tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Create snapshot completed successfully Apr 14 03:02:52 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 1073741824" returned: 0 in 0.576s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:52 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 Apr 14 03:02:52 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:52 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329" returned: 0 in 0.544s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f0213c-c7bb-4eae-b41e-f1103c4ecb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb275b2d-bdf4-4948-9815-adb820df5329', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716bad5d-4792-4f98-9d7f-01c54a25b44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:52 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Volume volume-fb275b2d-bdf4-4948-9815-adb820df5329 (fb275b2d-bdf4-4948-9815-adb820df5329): created successfully Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716bad5d-4792-4f98-9d7f-01c54a25b44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:52 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Flow 'volume_create_manager' (730fe999-5576-462c-98cd-bb91f4b0b3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:52 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c11252f4-a660-4348-a385-0f8ef2c72b35 tempest-ServersNegativeTestJSON-1971057229 None] Created volume successfully. Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "cinder-0c3245a2-8477-473a-b07a-a048e0c347dc-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-0c3245a2-8477-473a-b07a-a048e0c347dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "cinder-quobyte-09957a8f-d894-4a3d-987b-d94031ab01c3" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-quobyte-09957a8f-d894-4a3d-987b-d94031ab01c3" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "cinder-quobyte-0c3245a2-8477-473a-b07a-a048e0c347dc" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-quobyte-0c3245a2-8477-473a-b07a-a048e0c347dc" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Deleting offline snapshot 0c3245a2-8477-473a-b07a-a048e0c347dc of volume 09957a8f-d894-4a3d-987b-d94031ab01c3 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] snapshot_file for this snap is: volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[c852c5c7-ff13-443b-b26c-768212dc4701]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:53 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc Apr 14 03:02:53 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:53 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc" returned: 0 in 0.613s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09957a8f-d894-4a3d-987b-d94031ab01c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcac41b-68d4-40ea-a6c9-fe03d67a6bc0]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:53 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 Apr 14 03:02:53 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Flow 'volume_create_manager' (644b3088-0189-4cd6-a83d-f51c1be911c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34fb9fc-2b4d-4f5b-8c96-7f32c6c034d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34fb9fc-2b4d-4f5b-8c96-7f32c6c034d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1320656133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14636f84-9d4e-452d-8827-3ab4136e6475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0771f1851562495190b79331a5d27b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:54Z,use_quota=True,user_id='694e33d7f6554482a38eb346e73dee33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38629be-b9d2-4c4a-bfa9-cf46bc7c8517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38629be-b9d2-4c4a-bfa9-cf46bc7c8517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe96e031-d0de-4363-9e87-ca7ac71dc3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe96e031-d0de-4363-9e87-ca7ac71dc3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14636f84-9d4e-452d-8827-3ab4136e6475', 'volume_name': 'volume-14636f84-9d4e-452d-8827-3ab4136e6475', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3d56d5-27a1-4778-ac2d-f90aa0ea396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3d56d5-27a1-4778-ac2d-f90aa0ea396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f778740-eb71-4e70-adae-5f23e5303898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Volume 14636f84-9d4e-452d-8827-3ab4136e6475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14636f84-9d4e-452d-8827-3ab4136e6475', 'volume_size': 1} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1320656133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14636f84-9d4e-452d-8827-3ab4136e6475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0771f1851562495190b79331a5d27b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:54Z,use_quota=True,user_id='694e33d7f6554482a38eb346e73dee33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Creating volume 14636f84-9d4e-452d-8827-3ab4136e6475 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:54 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:54 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 1073741824 Apr 14 03:02:54 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:54 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3" returned: 0 in 0.769s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:54 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc Apr 14 03:02:54 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Flow 'volume_create_manager' (a767f1f7-be26-440c-81cc-f1d4ebe960ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3df8b82-bbda-4481-a0e4-8b6470d788e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3df8b82-bbda-4481-a0e4-8b6470d788e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1937375552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d0774c-5ec1-476e-a2a7-97919031ce2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ccaa9d08854eb28598f1de49259148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:55Z,use_quota=True,user_id='4d6f5df0a5ba4590ba8d1cf0edd67cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0265e682-3b43-49a1-ad32-699827ca2921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0265e682-3b43-49a1-ad32-699827ca2921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ecfdb5-295e-4bd3-9c4f-0fc97d55c744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ecfdb5-295e-4bd3-9c4f-0fc97d55c744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d0774c-5ec1-476e-a2a7-97919031ce2e', 'volume_name': 'volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb7307d-47d7-4ec3-925d-5251dd87a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb7307d-47d7-4ec3-925d-5251dd87a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:54 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83c492c-a1b9-4d56-bd4e-b09c0b53258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:54 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Volume f4d0774c-5ec1-476e-a2a7-97919031ce2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e', 'volume_size': 1} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 1073741824" returned: 0 in 0.675s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:54 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 Apr 14 03:02:54 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:55 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc" returned: 0 in 0.537s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:55 devstack sudo[86724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc Apr 14 03:02:55 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:55 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3.0c3245a2-8477-473a-b07a-a048e0c347dc" returned: 0 in 0.449s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-quobyte-0c3245a2-8477-473a-b07a-a048e0c347dc" released by "_delete_snapshot" :: held 2.453s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:55 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475" returned: 0 in 0.586s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-quobyte-09957a8f-d894-4a3d-987b-d94031ab01c3" released by "delete_snapshot" :: held 2.471s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1937375552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d0774c-5ec1-476e-a2a7-97919031ce2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ccaa9d08854eb28598f1de49259148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:02:55Z,use_quota=True,user_id='4d6f5df0a5ba4590ba8d1cf0edd67cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Creating volume f4d0774c-5ec1-476e-a2a7-97919031ce2e {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:02:55 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:55 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e 1073741824 Apr 14 03:02:55 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f778740-eb71-4e70-adae-5f23e5303898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14636f84-9d4e-452d-8827-3ab4136e6475', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1331f8-fb69-4045-9187-a84cafa90a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:55 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Volume volume-14636f84-9d4e-452d-8827-3ab4136e6475 (14636f84-9d4e-452d-8827-3ab4136e6475): created successfully Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1331f8-fb69-4045-9187-a84cafa90a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Flow 'volume_create_manager' (644b3088-0189-4cd6-a83d-f51c1be911c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:55 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-167cf437-e430-48da-8212-ffdf98c8d3ef tempest-VolumesTransfersV357Test-1951450008 None] Created volume successfully. Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Created reservations ['73d42e17-6a36-4f66-87aa-77c16cd2ba1f', '81c0335a-c77e-4ac9-be00-c080200bd303', '97d2e435-10f6-4fae-bfb3-dc29c8a2651b', 'ebcb2887-3319-47cb-8fcd-ecdf34587b0b'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:55 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Delete snapshot completed successfully. Apr 14 03:02:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6adf571c-4c2b-421e-aca0-90aa610a8faa tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-0c3245a2-8477-473a-b07a-a048e0c347dc-delete_snapshot" released by "delete_snapshot" :: held 2.604s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:56 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e 1073741824" returned: 0 in 0.512s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:56 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e Apr 14 03:02:56 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "cinder-09957a8f-d894-4a3d-987b-d94031ab01c3-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-09957a8f-d894-4a3d-987b-d94031ab01c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "cinder-quobyte-09957a8f-d894-4a3d-987b-d94031ab01c3" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-quobyte-09957a8f-d894-4a3d-987b-d94031ab01c3" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f242daa5-4eb3-4f3c-9ac2-521c01bd9994]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:56 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 Apr 14 03:02:56 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:56 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e" returned: 0 in 0.424s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83c492c-a1b9-4d56-bd4e-b09c0b53258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718c06ed-ee43-4bb0-8bcc-9396927f994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:02:56 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Volume volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e (f4d0774c-5ec1-476e-a2a7-97919031ce2e): created successfully Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718c06ed-ee43-4bb0-8bcc-9396927f994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Flow 'volume_create_manager' (a767f1f7-be26-440c-81cc-f1d4ebe960ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:02:56 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-4caf5e24-d5bc-43bb-8bec-9696c25124ca tempest-ServersNegativeTestJSON-1971057229 None] Created volume successfully. Apr 14 03:02:56 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-4a66407c-0534-4b95-99db-850ff2cf98e9 tempest-VolumesTransfersV357Test-132078430 None] Transfer volume completed successfully. Apr 14 03:02:56 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3" returned: 0 in 0.516s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:56 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3 Apr 14 03:02:56 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "cinder-f4d0774c-5ec1-476e-a2a7-97919031ce2e-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Lock "cinder-f4d0774c-5ec1-476e-a2a7-97919031ce2e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "cinder-quobyte-f4d0774c-5ec1-476e-a2a7-97919031ce2e" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Lock "cinder-quobyte-f4d0774c-5ec1-476e-a2a7-97919031ce2e" acquired by "delete_volume" :: waited 0.019s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4899cf-02a0-499d-8550-764bc710541e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:57 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-09957a8f-d894-4a3d-987b-d94031ab01c3" returned: 0 in 0.442s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-quobyte-09957a8f-d894-4a3d-987b-d94031ab01c3" released by "delete_volume" :: held 0.989s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:57 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e Apr 14 03:02:57 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Created reservations ['abce5287-e96c-442a-bedd-be252f793c3b', 'c25ede4e-eb5a-4374-9c24-5e96a5475447', '301d4583-5f3e-47ea-8fd0-e6c701cb6f6d', '7ddcb3f6-2fd0-4fa1-b91f-eab199e01099'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:57 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:57 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Acquiring lock "cinder-14636f84-9d4e-452d-8827-3ab4136e6475-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Lock "cinder-14636f84-9d4e-452d-8827-3ab4136e6475-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Acquiring lock "cinder-quobyte-14636f84-9d4e-452d-8827-3ab4136e6475" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Lock "cinder-quobyte-14636f84-9d4e-452d-8827-3ab4136e6475" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cd88d0-e303-4493-be25-9aaf8df500e9]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:57 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 Apr 14 03:02:57 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:57 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e" returned: 0 in 0.666s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:57 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.531s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Deleted volume successfully. Apr 14 03:02:57 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e Apr 14 03:02:57 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-65dbe7e7-aecc-4628-97d8-bf05c5c0cee1 tempest-VolumeSnapshotQuotasNegativeTestJSON-302497290 None] Lock "cinder-09957a8f-d894-4a3d-987b-d94031ab01c3-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:58 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475" returned: 0 in 0.686s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:58 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475 Apr 14 03:02:58 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:58 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d0774c-5ec1-476e-a2a7-97919031ce2e" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Lock "cinder-quobyte-f4d0774c-5ec1-476e-a2a7-97919031ce2e" released by "delete_volume" :: held 1.187s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Created reservations ['3d328a04-9e82-4592-8179-e8111ac2b269', '5dbf89b5-279b-4499-9a36-cdaa6bb89a06', 'cd0870ad-2f59-4422-ae37-8a249df22e99', 'd851180d-b177-4c77-89fb-4a093a913c81'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:58 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:58 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:58 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14636f84-9d4e-452d-8827-3ab4136e6475" returned: 0 in 0.525s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Lock "cinder-quobyte-14636f84-9d4e-452d-8827-3ab4136e6475" released by "delete_volume" :: held 1.235s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Created reservations ['e8c45967-1a9b-4804-8df1-68494da5ecd9', '40a27db5-e10a-45eb-b8d0-6a5558aae217', 'f4882017-8c75-48d4-92ad-d3e67a53bdec', 'cdba92ff-fdef-4d82-bf5c-3d47553c9bc7'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:02:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:58 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:02:58 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:02:59 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.558s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Deleted volume successfully. Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e4183017-53fa-4217-9506-f6d8302334af tempest-ServersNegativeTestJSON-1971057229 None] Lock "cinder-f4d0774c-5ec1-476e-a2a7-97919031ce2e-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "cinder-fb275b2d-bdf4-4948-9815-adb820df5329-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Lock "cinder-fb275b2d-bdf4-4948-9815-adb820df5329-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:59 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "cinder-quobyte-fb275b2d-bdf4-4948-9815-adb820df5329" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.463s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:02:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Deleted volume successfully. Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Lock "cinder-quobyte-fb275b2d-bdf4-4948-9815-adb820df5329" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2e43ce61-7e27-4bce-9707-5b7c62b1a3e7 tempest-VolumesTransfersV357Test-2050758758 None] Lock "cinder-14636f84-9d4e-452d-8827-3ab4136e6475-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1101bbd2-e4fd-4e90-bcdd-cac7f8d77f7d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:02:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:02:59 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 Apr 14 03:02:59 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Flow 'volume_create_manager' (3c17be83-d039-4f01-acf4-127f6aedd1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5f6309-5156-494d-ae94-65a283ee1b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:00 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5f6309-5156-494d-ae94-65a283ee1b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-791802203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5597694a-2640-4cdd-a356-0f9b0e55fd0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0771f1851562495190b79331a5d27b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:00Z,use_quota=True,user_id='694e33d7f6554482a38eb346e73dee33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bc8e01-223c-4d36-b19a-f8c1fdcac7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bc8e01-223c-4d36-b19a-f8c1fdcac7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9e80ad-f70f-4e34-9729-e7739d9f623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9e80ad-f70f-4e34-9729-e7739d9f623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5597694a-2640-4cdd-a356-0f9b0e55fd0e', 'volume_name': 'volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76961136-60ea-48a6-9250-a3ea2bf0f75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76961136-60ea-48a6-9250-a3ea2bf0f75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41df29a9-f186-4a22-abf2-7480c74b8439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:00 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Volume 5597694a-2640-4cdd-a356-0f9b0e55fd0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e', 'volume_size': 1} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-791802203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5597694a-2640-4cdd-a356-0f9b0e55fd0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0771f1851562495190b79331a5d27b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:00Z,use_quota=True,user_id='694e33d7f6554482a38eb346e73dee33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Creating volume 5597694a-2640-4cdd-a356-0f9b0e55fd0e {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:00 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329" returned: 0 in 0.701s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:00 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e 1073741824 Apr 14 03:03:00 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:00 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329 Apr 14 03:03:00 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:00 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb275b2d-bdf4-4948-9815-adb820df5329" returned: 0 in 0.483s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Lock "cinder-quobyte-fb275b2d-bdf4-4948-9815-adb820df5329" released by "delete_volume" :: held 1.226s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Created reservations ['958e29da-b095-47b0-9e26-fc9ac456b0e8', 'a22d71bb-e72d-4391-ae0b-c57a56d85335', 'b15e8bc7-c476-4a50-a609-4f510450500c', '30215f0e-4040-43c8-a735-e03107b47b4d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:00 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:00 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e 1073741824" returned: 0 in 0.616s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:00 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:00 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e Apr 14 03:03:00 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Flow 'volume_create_manager' (edae9a35-2ed4-481c-9d38-a852c8a63135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa9ebf9-6508-40d8-804d-860ea8bdf5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:01 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:01 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Deleted volume successfully. Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa9ebf9-6508-40d8-804d-860ea8bdf5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-625733356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da745e8a-2095-4b3d-a6d7-d64465126c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94aa981783f24035932def49a36e6e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:01Z,use_quota=True,user_id='72f548e9051646ecb83d4eb26e23a5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb9d9456-b6cd-4ad5-ab56-421dc48ab04e),volume_type_id=bb9d9456-b6cd-4ad5-ab56-421dc48ab04e)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e60fdd-dd04-4cf8-8852-a961a5f00434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e60fdd-dd04-4cf8-8852-a961a5f00434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4bd333-a989-4ad1-b205-22a9cbe90b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4bd333-a989-4ad1-b205-22a9cbe90b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da745e8a-2095-4b3d-a6d7-d64465126c19', 'volume_name': 'volume-da745e8a-2095-4b3d-a6d7-d64465126c19', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e39134-d401-4a10-9564-f92f7642991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e39134-d401-4a10-9564-f92f7642991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:01 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd250a6-999c-4c32-83a8-e56430d40a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:01 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Volume da745e8a-2095-4b3d-a6d7-d64465126c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da745e8a-2095-4b3d-a6d7-d64465126c19', 'volume_size': 1} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e" returned: 0 in 0.476s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e759aa7f-f43c-49a6-a39b-0d3bb072f6a3 tempest-ServersNegativeTestJSON-1971057229 None] Lock "cinder-fb275b2d-bdf4-4948-9815-adb820df5329-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-625733356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da745e8a-2095-4b3d-a6d7-d64465126c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94aa981783f24035932def49a36e6e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:01Z,use_quota=True,user_id='72f548e9051646ecb83d4eb26e23a5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb9d9456-b6cd-4ad5-ab56-421dc48ab04e),volume_type_id=bb9d9456-b6cd-4ad5-ab56-421dc48ab04e)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Creating volume da745e8a-2095-4b3d-a6d7-d64465126c19 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:01 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41df29a9-f186-4a22-abf2-7480c74b8439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:01 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 1073741824 Apr 14 03:03:01 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9deb3b-4bd6-41ff-b0af-fce3d23d34a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:01 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Volume volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e (5597694a-2640-4cdd-a356-0f9b0e55fd0e): created successfully Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9deb3b-4bd6-41ff-b0af-fce3d23d34a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Flow 'volume_create_manager' (3c17be83-d039-4f01-acf4-127f6aedd1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:01 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-36c47f14-63c8-442d-a2bb-c88f6373f1b4 tempest-VolumesTransfersV357Test-1951450008 None] Created volume successfully. Apr 14 03:03:01 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 1073741824" returned: 0 in 0.580s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:01 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 Apr 14 03:03:01 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:02 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19" returned: 0 in 0.484s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd250a6-999c-4c32-83a8-e56430d40a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da745e8a-2095-4b3d-a6d7-d64465126c19', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dd1bd7-93e4-4d36-ad56-3487a7e11ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Acquiring lock "cinder-5597694a-2640-4cdd-a356-0f9b0e55fd0e-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:02 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Volume volume-da745e8a-2095-4b3d-a6d7-d64465126c19 (da745e8a-2095-4b3d-a6d7-d64465126c19): created successfully Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01dd1bd7-93e4-4d36-ad56-3487a7e11ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Flow 'volume_create_manager' (edae9a35-2ed4-481c-9d38-a852c8a63135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:02 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-50ce4c46-cace-4375-b0ca-3aaceb34842a tempest-VolumeTypesAccessTest-576693193 None] Created volume successfully. Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Lock "cinder-5597694a-2640-4cdd-a356-0f9b0e55fd0e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Acquiring lock "cinder-quobyte-5597694a-2640-4cdd-a356-0f9b0e55fd0e" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Lock "cinder-quobyte-5597694a-2640-4cdd-a356-0f9b0e55fd0e" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5495b0a0-02d9-4c4d-aed5-a65f7d7adbff]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:02 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e Apr 14 03:03:02 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:03 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e" returned: 0 in 0.561s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:03 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e Apr 14 03:03:03 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Acquiring lock "cinder-da745e8a-2095-4b3d-a6d7-d64465126c19-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Lock "cinder-da745e8a-2095-4b3d-a6d7-d64465126c19-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Acquiring lock "cinder-quobyte-da745e8a-2095-4b3d-a6d7-d64465126c19" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Lock "cinder-quobyte-da745e8a-2095-4b3d-a6d7-d64465126c19" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[64df8eee-2b0b-4548-821b-7249a7481f6b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:03 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5597694a-2640-4cdd-a356-0f9b0e55fd0e" returned: 0 in 0.462s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Lock "cinder-quobyte-5597694a-2640-4cdd-a356-0f9b0e55fd0e" released by "delete_volume" :: held 1.045s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:03 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 Apr 14 03:03:03 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Created reservations ['212f5329-3a8e-4570-9e7f-fea363e32327', '11a9c9c8-5cb5-480c-a702-2f02507d5451', '155fdacf-a86f-4170-a14d-6bc642cac75e', '9eb31f1c-09dc-4842-a0c8-6c997fb54483'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:03 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:03 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:03 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19" returned: 0 in 0.543s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:03 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19 Apr 14 03:03:03 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:04 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.450s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:04 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Deleted volume successfully. Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eefdf13d-cca7-4c9f-bba5-df9f8d9fc8e8 tempest-VolumesTransfersV357Test-2050758758 None] Lock "cinder-5597694a-2640-4cdd-a356-0f9b0e55fd0e-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:04 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-da745e8a-2095-4b3d-a6d7-d64465126c19" returned: 0 in 0.511s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Lock "cinder-quobyte-da745e8a-2095-4b3d-a6d7-d64465126c19" released by "delete_volume" :: held 1.078s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:04 devstack cinder-volume[82473]: WARNING cinder.quota [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2038588506 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2038588506, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:03:04 devstack cinder-volume[82473]: WARNING cinder.quota [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2038588506 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2038588506, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Created reservations ['23f2b9de-d8b7-44c4-b9e0-c8dcd7fac36b', 'a92c4805-4606-48da-bc48-5ba28114efd9', 'd60ac6ee-98bf-4798-a938-3503db1df631', 'b800be64-9572-4bd4-bf0b-1fcda80fe94d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:04 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:04 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:05 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.507s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:05 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:05 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Deleted volume successfully. Apr 14 03:03:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7996a060-e438-40c3-a5fe-75d4ae240715 tempest-VolumeTypesAccessTest-576693193 None] Lock "cinder-da745e8a-2095-4b3d-a6d7-d64465126c19-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:14 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=55,cinder:UPDATE=76,cinder:INSERT=20,cinder:DELETE=5 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:03:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:03:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:14 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:14 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:15 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=65,cinder:INSERT=23,cinder:UPDATE=101,cinder:DELETE=10 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:03:15 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.563s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Flow 'volume_create_manager' (beaa6583-19a9-4e03-9aa9-a96d49e93dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902bfd1d-9702-4917-b64e-6a51e83544e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902bfd1d-9702-4917-b64e-6a51e83544e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1807265432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d51c4c-79a5-42d5-a811-ee7829e21a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cb87ab981a4a428b34ad90044ee9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:18Z,use_quota=True,user_id='450ec6a3bd824574bebec6221a5e7bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13261c6a-298a-49f3-b283-e0ac474c9a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13261c6a-298a-49f3-b283-e0ac474c9a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae95fb-63ef-4bec-8384-8987e9a6bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ae95fb-63ef-4bec-8384-8987e9a6bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d51c4c-79a5-42d5-a811-ee7829e21a22', 'volume_name': 'volume-44d51c4c-79a5-42d5-a811-ee7829e21a22', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1126b3a-2525-448c-9b61-f8815041b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1126b3a-2525-448c-9b61-f8815041b236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d79d40-5c84-4306-bae3-ff4bc6caed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:17 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Volume 44d51c4c-79a5-42d5-a811-ee7829e21a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d51c4c-79a5-42d5-a811-ee7829e21a22', 'volume_size': 1} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1807265432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d51c4c-79a5-42d5-a811-ee7829e21a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cb87ab981a4a428b34ad90044ee9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:18Z,use_quota=True,user_id='450ec6a3bd824574bebec6221a5e7bed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Creating volume 44d51c4c-79a5-42d5-a811-ee7829e21a22 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:17 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:17 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 1073741824 Apr 14 03:03:17 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:18 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 1073741824" returned: 0 in 0.536s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:18 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 Apr 14 03:03:18 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:18 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22" returned: 0 in 0.510s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d79d40-5c84-4306-bae3-ff4bc6caed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d51c4c-79a5-42d5-a811-ee7829e21a22', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316862dd-7e22-4dba-b343-c1c0957e996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:18 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Volume volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 (44d51c4c-79a5-42d5-a811-ee7829e21a22): created successfully Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316862dd-7e22-4dba-b343-c1c0957e996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:18 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Flow 'volume_create_manager' (beaa6583-19a9-4e03-9aa9-a96d49e93dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:18 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-0203d604-eff5-4a99-a14d-e80a6100c8e7 req-0bbeabd0-f69f-4ec6-bf9d-03da08e56e27 tempest-VolumesSnapshotsTestJSON-306063074 None] Created volume successfully. Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Creating offline snapshot 69d52389-e86b-4824-84a3-4f0febe8fb3c of volume 44d51c4c-79a5-42d5-a811-ee7829e21a22 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f77b1f-c569-41e9-9446-759e6871202b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:20 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 Apr 14 03:03:20 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Flow 'volume_create_manager' (c1b457f6-5ba1-448d-a522-5e6e684b479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a85581-f95b-4fad-a9a1-d10c67d6fc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a85581-f95b-4fad-a9a1-d10c67d6fc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-682322591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665d60af-6ec7-491c-af15-17845671ea70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51eb7227e03e4f8e9202e418c74f99c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:20Z,use_quota=True,user_id='c2ce5df77e284f41aad0d918ab85eaf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ebc29a-7cf2-4739-b056-c374f51ba154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ebc29a-7cf2-4739-b056-c374f51ba154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20c5ef3-1dee-4cba-b921-2933bebc4c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20c5ef3-1dee-4cba-b921-2933bebc4c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665d60af-6ec7-491c-af15-17845671ea70', 'volume_name': 'volume-665d60af-6ec7-491c-af15-17845671ea70', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47de386b-6251-4fb3-92f3-1aef1510174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47de386b-6251-4fb3-92f3-1aef1510174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2da99a-a831-4b2b-bef0-23a50a96179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:20 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Volume 665d60af-6ec7-491c-af15-17845671ea70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665d60af-6ec7-491c-af15-17845671ea70', 'volume_size': 1} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:20 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22" returned: 0 in 0.712s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:20 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c 1G Apr 14 03:03:20 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:21 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c 1G" returned: 0 in 0.560s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:21 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c Apr 14 03:03:21 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Flow 'volume_create_manager' (e05b36d8-4b36-47e1-8807-e7d6a0705d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80829d44-e33d-45df-a007-68665e08c364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80829d44-e33d-45df-a007-68665e08c364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-595007379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c77dbf-3182-408c-bcb6-6819bfae6267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798ddfa15bba49bebe3898ce80df0db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:22Z,use_quota=True,user_id='d8642ae50bf343f0ba0293718658dd4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383b65ec-a3a2-4dd6-9eee-eae3dfee8b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383b65ec-a3a2-4dd6-9eee-eae3dfee8b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e71c7-8935-455f-9ac3-830e119178b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.image.glance [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Creating Keystone auth plugin from conf {{(pid=82473) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e71c7-8935-455f-9ac3-830e119178b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23c77dbf-3182-408c-bcb6-6819bfae6267', 'volume_name': 'volume-23c77dbf-3182-408c-bcb6-6819bfae6267', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe909a2-437d-41ad-a685-afdcbe0b8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe909a2-437d-41ad-a685-afdcbe0b8241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f74fef-25b3-4649-8a2f-15079f330f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:21 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Volume 23c77dbf-3182-408c-bcb6-6819bfae6267: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23c77dbf-3182-408c-bcb6-6819bfae6267', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Trying to clone 23c77dbf-3182-408c-bcb6-6819bfae6267 from image 9179ce72-7062-46a0-b714-df74aac4cc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]). {{(pid=82473) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 14 03:03:21 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Image download 20.69 MB at 20.69 MB/s Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac43cdf1-3524-4c79-8d8c-c89c98b5784d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:21 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c" returned: 0 in 0.498s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:21 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c is being set with open permissions: ugo+rw Apr 14 03:03:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:22 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c Apr 14 03:03:22 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:22 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD Apr 14 03:03:22 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:22 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c" returned: 0 in 0.404s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:22 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.info Apr 14 03:03:22 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:22 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Temporary image 9179ce72-7062-46a0-b714-df74aac4cc2c is fetched for user d8642ae50bf343f0ba0293718658dd4c. {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc78fc5-77c4-4d31-a562-c4cccef7b7b3]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:22 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD Apr 14 03:03:22 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:22 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.info" returned: 0 in 0.439s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:22 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.info is being set with open permissions: ugo+rw Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:22 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.info Apr 14 03:03:22 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:22 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:23 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.info" returned: 0 in 0.400s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.083s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.712s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-682322591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665d60af-6ec7-491c-af15-17845671ea70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51eb7227e03e4f8e9202e418c74f99c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:20Z,use_quota=True,user_id='c2ce5df77e284f41aad0d918ab85eaf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Creating volume 665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:23 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:23 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 1073741824 Apr 14 03:03:23 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-d43a20ed-7812-45a1-92be-f0f7cc6fd166 req-d6d5d18c-7b31-4f4f-8682-64f0e1807500 tempest-VolumesSnapshotsTestJSON-306063074 None] Create snapshot completed successfully Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "cinder-69d52389-e86b-4824-84a3-4f0febe8fb3c-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-69d52389-e86b-4824-84a3-4f0febe8fb3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "cinder-quobyte-44d51c4c-79a5-42d5-a811-ee7829e21a22" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:23 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 1073741824" returned: 0 in 0.537s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-quobyte-44d51c4c-79a5-42d5-a811-ee7829e21a22" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "cinder-quobyte-69d52389-e86b-4824-84a3-4f0febe8fb3c" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-quobyte-69d52389-e86b-4824-84a3-4f0febe8fb3c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Deleting offline snapshot 69d52389-e86b-4824-84a3-4f0febe8fb3c of volume 44d51c4c-79a5-42d5-a811-ee7829e21a22 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] snapshot_file for this snap is: volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fd80db-7209-4671-9ecf-1579546989f6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:23 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:03:23 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:23 devstack sudo[86909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c Apr 14 03:03:23 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:24 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.392s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-595007379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c77dbf-3182-408c-bcb6-6819bfae6267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798ddfa15bba49bebe3898ce80df0db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:22Z,use_quota=True,user_id='d8642ae50bf343f0ba0293718658dd4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Creating volume 23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:24 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2da99a-a831-4b2b-bef0-23a50a96179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665d60af-6ec7-491c-af15-17845671ea70', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54829d25-529f-4b49-aa8a-0933cd5e8f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:24 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 1073741824 Apr 14 03:03:24 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:24 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Volume volume-665d60af-6ec7-491c-af15-17845671ea70 (665d60af-6ec7-491c-af15-17845671ea70): created successfully Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54829d25-529f-4b49-aa8a-0933cd5e8f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Flow 'volume_create_manager' (c1b457f6-5ba1-448d-a522-5e6e684b479d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5b6ee274-b780-420d-a616-3fe95220b4c9 tempest-VolumesActionsTest-1322041277 None] Created volume successfully. Apr 14 03:03:24 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d51c4c-79a5-42d5-a811-ee7829e21a22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[02abee0b-47a3-4d8e-9398-866148c2a48c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:24 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 Apr 14 03:03:24 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:24 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 1073741824" returned: 0 in 0.530s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:24 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 Apr 14 03:03:24 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:24 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22" returned: 0 in 0.595s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:24 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c Apr 14 03:03:24 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:25 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267" returned: 0 in 0.489s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Attempting download of 9179ce72-7062-46a0-b714-df74aac4cc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}])) to volume 23c77dbf-3182-408c-bcb6-6819bfae6267. {{(pid=82473) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb466a1e-c090-469c-bc60-aa7c7adf4269]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_if0bo6k3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:25 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_if0bo6k3 Apr 14 03:03:25 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:25 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c" returned: 0 in 0.536s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:25 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c Apr 14 03:03:25 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:25 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_if0bo6k3" returned: 0 in 0.533s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_if0bo6k3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:26 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_if0bo6k3 Apr 14 03:03:26 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:26 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22.69d52389-e86b-4824-84a3-4f0febe8fb3c" returned: 0 in 0.515s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-quobyte-69d52389-e86b-4824-84a3-4f0febe8fb3c" released by "_delete_snapshot" :: held 2.201s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-quobyte-44d51c4c-79a5-42d5-a811-ee7829e21a22" released by "delete_snapshot" :: held 2.216s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG cinder.quota [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Created reservations ['72d94215-3919-4a50-ace9-4e47fa270124', 'b24f22b7-11df-42db-8ab4-fcd38c5dbe7d', 'a9ea0b4d-6eb4-425e-bf1e-517bcb476475', 'e8584d5d-37c5-43c1-8942-09d8e742096a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:26 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Delete snapshot completed successfully. Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-5ea4f015-960d-46b7-bf40-2df9e1ca79b7 req-606b2e3f-4c8f-47b0-a366-62fb154e1076 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-69d52389-e86b-4824-84a3-4f0febe8fb3c-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:26 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_if0bo6k3" returned: 1 in 0.525s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_if0bo6k3' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd34499-e2b6-40da-b45c-ad55625ee5be]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:26 devstack sudo[86949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD Apr 14 03:03:26 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:26 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] 9179ce72-7062-46a0-b714-df74aac4cc2c was qcow2, converting to raw {{(pid=82473) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 14 03:03:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:26 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 Apr 14 03:03:26 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "cinder-44d51c4c-79a5-42d5-a811-ee7829e21a22-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-44d51c4c-79a5-42d5-a811-ee7829e21a22-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "cinder-quobyte-44d51c4c-79a5-42d5-a811-ee7829e21a22" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-quobyte-44d51c4c-79a5-42d5-a811-ee7829e21a22" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[2074ee80-f094-44cb-84d0-9b1a553c11d5]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:27 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 Apr 14 03:03:27 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:27 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22" returned: 0 in 0.574s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:27 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22 Apr 14 03:03:27 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267" returned: 0 in 0.870s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_02yxw8z0devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:03:27 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:27 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Converted 112.00 MB image at 112.00 MB/s Apr 14 03:03:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:27 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 1G Apr 14 03:03:27 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:28 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-44d51c4c-79a5-42d5-a811-ee7829e21a22" returned: 0 in 0.446s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-quobyte-44d51c4c-79a5-42d5-a811-ee7829e21a22" released by "delete_volume" :: held 1.047s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG cinder.quota [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Created reservations ['5c5259eb-e5a5-4d66-b81b-57ed2e850609', 'ff819c60-28c3-4f5d-bcda-855b72974f98', '7e0b6bdb-6e65-450c-95f7-607cd3dc29a6', '8f4922dd-650e-4d66-b526-ac7ab7b3342c'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:28 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:28 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:28 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 1G" returned: 0 in 0.477s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[877eb75a-8961-4802-9638-300a2bc0506c]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:28 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 Apr 14 03:03:28 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:28 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG cinder.manager [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:28 devstack cinder-volume[82473]: INFO cinder.volume.manager [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Deleted volume successfully. Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [req-7c8a58a6-66e6-4f75-bb6b-d288f517d427 req-8de3bf2a-10d4-40da-baed-88c87ab35442 tempest-VolumesSnapshotsTestJSON-306063074 None] Lock "cinder-44d51c4c-79a5-42d5-a811-ee7829e21a22-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:28 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:28 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 Apr 14 03:03:28 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:29 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267" returned: 1 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Downloaded image 9179ce72-7062-46a0-b714-df74aac4cc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}])) to volume 23c77dbf-3182-408c-bcb6-6819bfae6267 successfully. {{(pid=82473) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Temporary image 9179ce72-7062-46a0-b714-df74aac4cc2c for user d8642ae50bf343f0ba0293718658dd4c is deleted. {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Marking volume 23c77dbf-3182-408c-bcb6-6819bfae6267 as bootable. {{(pid=82473) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Copying metadata from image 9179ce72-7062-46a0-b714-df74aac4cc2c to 23c77dbf-3182-408c-bcb6-6819bfae6267. {{(pid=82473) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Creating volume glance metadata for volume 23c77dbf-3182-408c-bcb6-6819bfae6267 backed by image 9179ce72-7062-46a0-b714-df74aac4cc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82473) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f74fef-25b3-4649-8a2f-15079f330f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c77dbf-3182-408c-bcb6-6819bfae6267', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf187d6a-45da-4cf7-a0a2-e0ae7d170533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:29 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Volume volume-23c77dbf-3182-408c-bcb6-6819bfae6267 (23c77dbf-3182-408c-bcb6-6819bfae6267): created successfully Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf187d6a-45da-4cf7-a0a2-e0ae7d170533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Flow 'volume_create_manager' (e05b36d8-4b36-47e1-8807-e7d6a0705d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:29 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a48972dc-2dae-4342-97b4-7482f4b30f4a tempest-VolumesImageMetadata-1662920625 None] Created volume successfully. Apr 14 03:03:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Acquiring lock "cinder-23c77dbf-3182-408c-bcb6-6819bfae6267-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Lock "cinder-23c77dbf-3182-408c-bcb6-6819bfae6267-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Acquiring lock "cinder-quobyte-23c77dbf-3182-408c-bcb6-6819bfae6267" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Lock "cinder-quobyte-23c77dbf-3182-408c-bcb6-6819bfae6267" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:30 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[683a3ca4-7bfd-499d-b6fa-2ad8b356abae]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:30 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 Apr 14 03:03:30 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:30 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267" returned: 0 in 0.623s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:31 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 Apr 14 03:03:31 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:31 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267" returned: 1 in 0.629s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:03:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:31 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267 Apr 14 03:03:31 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b13486f6-934d-49d2-b447-33417bd665eb tempest-GroupSnapshotsTest-719658903 None] Group tempest-GroupSnapshotsTest-Group-2104961280: creating Apr 14 03:03:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b13486f6-934d-49d2-b447-33417bd665eb tempest-GroupSnapshotsTest-719658903 None] Group tempest-GroupSnapshotsTest-Group-2104961280: created successfully Apr 14 03:03:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b13486f6-934d-49d2-b447-33417bd665eb tempest-GroupSnapshotsTest-719658903 None] Create group completed successfully. Apr 14 03:03:32 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-23c77dbf-3182-408c-bcb6-6819bfae6267" returned: 0 in 0.459s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Lock "cinder-quobyte-23c77dbf-3182-408c-bcb6-6819bfae6267" released by "delete_volume" :: held 1.761s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Created reservations ['520f251e-2ecc-4436-9526-c64e0993b690', 'c1f85b2e-8206-4465-9239-58b4aa1f409a', '748600aa-d6ac-4eae-9275-b96e2dff26ab', 'dda45b7a-6817-4203-9042-73cc0b0b05b2'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:32 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:32 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:32 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.411s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Deleted volume successfully. Apr 14 03:03:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a2f53e78-6a95-4062-82dd-aff6313d9377 tempest-VolumesImageMetadata-1662920625 None] Lock "cinder-23c77dbf-3182-408c-bcb6-6819bfae6267-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Flow 'volume_create_manager' (fd8cd268-868c-4022-b051-899f2cb282ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3f10fa-57b4-46ea-b412-b5aa66461730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3f10fa-57b4-46ea-b412-b5aa66461730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394841002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f8843b8-ce0d-48d6-a75a-715cef618a7f,host='devstack@QuobyteHD#QuobyteHD',id=1afba7eb-37f8-412d-a9cf-115e645c07ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f83ef39148c4c8f891ee5a0f5dfc046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:33Z,use_quota=True,user_id='3070afc3c0fb4f78b133ee43adb05d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5286abe5-d175-45d3-aaa2-de9709577ff4),volume_type_id=5286abe5-d175-45d3-aaa2-de9709577ff4)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b214bf-6ff5-4c83-be3d-638055183d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b214bf-6ff5-4c83-be3d-638055183d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35f0efa-da8e-42ad-b365-ae40edf4461f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35f0efa-da8e-42ad-b365-ae40edf4461f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afba7eb-37f8-412d-a9cf-115e645c07ce', 'volume_name': 'volume-1afba7eb-37f8-412d-a9cf-115e645c07ce', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adda2175-b58d-41e0-85d9-c5357753f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adda2175-b58d-41e0-85d9-c5357753f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955f1574-005d-4296-a936-402f68a78f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:33 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Volume 1afba7eb-37f8-412d-a9cf-115e645c07ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afba7eb-37f8-412d-a9cf-115e645c07ce', 'volume_size': 1} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f8843b8-ce0d-48d6-a75a-715cef618a7f,created_at=2026-04-14T01:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394841002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f8843b8-ce0d-48d6-a75a-715cef618a7f,host='devstack@QuobyteHD#QuobyteHD',id=1afba7eb-37f8-412d-a9cf-115e645c07ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f83ef39148c4c8f891ee5a0f5dfc046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:33Z,use_quota=True,user_id='3070afc3c0fb4f78b133ee43adb05d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5286abe5-d175-45d3-aaa2-de9709577ff4),volume_type_id=5286abe5-d175-45d3-aaa2-de9709577ff4)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Creating volume 1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:33 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:33 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce 1073741824 Apr 14 03:03:33 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:33 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce 1073741824" returned: 0 in 0.616s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:33 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce Apr 14 03:03:33 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Flow 'volume_create_manager' (7aecda08-6631-4cc2-83a1-091aca13d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87ae03-9fd2-477f-a217-f62e032d9513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e87ae03-9fd2-477f-a217-f62e032d9513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-235801854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b461bd9-2d60-4677-aafc-ba79b38fa5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb3ecee21ea4e8a82a8d477a2e207c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:34Z,use_quota=True,user_id='f96baf4b72da4974bac91489a5778276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad2ac14-5ad8-46b2-89ee-1c088009bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad2ac14-5ad8-46b2-89ee-1c088009bde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f45471-d399-46c2-9840-96cde449e660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f45471-d399-46c2-9840-96cde449e660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b461bd9-2d60-4677-aafc-ba79b38fa5a0', 'volume_name': 'volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6ec300-1c36-4f6b-943f-67918af07c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6ec300-1c36-4f6b-943f-67918af07c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f370b6ce-0b19-4bb4-89d9-c9a8f1930288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:34 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Volume 5b461bd9-2d60-4677-aafc-ba79b38fa5a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0', 'volume_size': 1} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:34 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-235801854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b461bd9-2d60-4677-aafc-ba79b38fa5a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb3ecee21ea4e8a82a8d477a2e207c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:34Z,use_quota=True,user_id='f96baf4b72da4974bac91489a5778276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Creating volume 5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:34 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955f1574-005d-4296-a936-402f68a78f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afba7eb-37f8-412d-a9cf-115e645c07ce', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:34 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 1073741824 Apr 14 03:03:34 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29451804-49b1-4458-abcc-aeca81d0e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:34 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Volume volume-1afba7eb-37f8-412d-a9cf-115e645c07ce (1afba7eb-37f8-412d-a9cf-115e645c07ce): created successfully Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29451804-49b1-4458-abcc-aeca81d0e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Flow 'volume_create_manager' (fd8cd268-868c-4022-b051-899f2cb282ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:34 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6252f3ae-f70f-49c9-ba31-c57dfe97d6df tempest-GroupSnapshotsTest-719658903 None] Created volume successfully. Apr 14 03:03:34 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 1073741824" returned: 0 in 0.466s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:34 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 Apr 14 03:03:34 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:35 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" returned: 0 in 0.421s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f370b6ce-0b19-4bb4-89d9-c9a8f1930288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e4f514-3e88-4026-9e15-30129013d9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:35 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Volume volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 (5b461bd9-2d60-4677-aafc-ba79b38fa5a0): created successfully Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e4f514-3e88-4026-9e15-30129013d9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Flow 'volume_create_manager' (7aecda08-6631-4cc2-83a1-091aca13d445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-909a42a8-3c6a-4001-a7f1-9bd477aff6ec tempest-VolumesDeleteCascade-614937133 None] Created volume successfully. Apr 14 03:03:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] GroupSnapshot 05f88a30-3e15-4c88-9354-a9fd08864a67: creating. Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Group snapshot 05f88a30-3e15-4c88-9354-a9fd08864a67: creating. {{(pid=82473) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Creating offline snapshot 313cabe9-20ee-442d-8695-e67e2abe2e4a of volume 1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[071bd4f5-5667-4163-a00b-1eb31b92d84c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:35 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce Apr 14 03:03:35 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:36 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce" returned: 0 in 0.457s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:36 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a 1G Apr 14 03:03:36 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:36 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a 1G" returned: 0 in 0.648s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afba7eb-37f8-412d-a9cf-115e645c07ce -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:36 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afba7eb-37f8-412d-a9cf-115e645c07ce -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a Apr 14 03:03:36 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:37 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1afba7eb-37f8-412d-a9cf-115e645c07ce -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a" returned: 0 in 0.506s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:37 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:03:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:37 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a Apr 14 03:03:37 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:37 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a" returned: 0 in 0.428s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:37 devstack sudo[87093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.info Apr 14 03:03:37 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-acb02418-5433-4fab-b5c2-60c0844fe9c1 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "cinder-665d60af-6ec7-491c-af15-17845671ea70" by "attach_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-acb02418-5433-4fab-b5c2-60c0844fe9c1 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70" acquired by "attach_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-acb02418-5433-4fab-b5c2-60c0844fe9c1 tempest-VolumesActionsTest-1322041277 None] Attaching volume 665d60af-6ec7-491c-af15-17845671ea70 to instance 6b5faad3-9111-4226-80a6-3328dba8176d at mountpoint /dev/vdb on host None. Apr 14 03:03:38 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.info" returned: 0 in 0.466s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:38 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-acb02418-5433-4fab-b5c2-60c0844fe9c1 tempest-VolumesActionsTest-1322041277 None] Attach volume completed successfully. Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-acb02418-5433-4fab-b5c2-60c0844fe9c1 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70" released by "attach_volume" :: held 0.074s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:38 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.info Apr 14 03:03:38 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:38 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.info" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.996s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.026s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Creating offline snapshot 9730bd52-9091-4423-8315-2a14427dceaa of volume 5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a6667-d941-4dd3-9682-ba5bd3421716]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:38 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 Apr 14 03:03:38 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-72e02322-9818-4796-80f4-6ac4b1320819 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-detach_volume" by "detach_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-72e02322-9818-4796-80f4-6ac4b1320819 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-72e02322-9818-4796-80f4-6ac4b1320819 tempest-VolumesActionsTest-1322041277 None] Detaching volume 665d60af-6ec7-491c-af15-17845671ea70 from instance 6b5faad3-9111-4226-80a6-3328dba8176d. Apr 14 03:03:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a031a5f7-ec91-4204-8f34-0a6877ecf734 tempest-GroupSnapshotsTest-719658903 None] group_snapshot 05f88a30-3e15-4c88-9354-a9fd08864a67: created successfully Apr 14 03:03:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-72e02322-9818-4796-80f4-6ac4b1320819 tempest-VolumesActionsTest-1322041277 None] Detach volume completed successfully. Apr 14 03:03:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-72e02322-9818-4796-80f4-6ac4b1320819 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:39 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" returned: 0 in 0.538s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:39 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa 1G Apr 14 03:03:39 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:39 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa 1G" returned: 0 in 0.587s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:39 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa Apr 14 03:03:39 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:40 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa" returned: 0 in 0.462s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:40 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa is being set with open permissions: ugo+rw Apr 14 03:03:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:40 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa Apr 14 03:03:40 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:40 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa" returned: 0 in 0.526s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:40 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.info Apr 14 03:03:40 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:41 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.info" returned: 0 in 0.526s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:41 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.info is being set with open permissions: ugo+rw Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:41 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.info Apr 14 03:03:41 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:41 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.info" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.957s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-313cabe9-20ee-442d-8695-e67e2abe2e4a-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" by "_create_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-313cabe9-20ee-442d-8695-e67e2abe2e4a-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Creating volume 571f4e7d-0f7c-41f5-a0d2-b4e85e958228 from snapshot 313cabe9-20ee-442d-8695-e67e2abe2e4a {{(pid=82473) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:41 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f1083eeb-cd60-4e14-9f5d-ea095dd4859f tempest-VolumesDeleteCascade-614937133 None] Create snapshot completed successfully Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] snapshot: 313cabe9-20ee-442d-8695-e67e2abe2e4a, volume: 571f4e7d-0f7c-41f5-a0d2-b4e85e958228, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2f9441-3e34-46d8-8a64-0298e8b5cd9c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:41 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a Apr 14 03:03:41 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:42 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a" returned: 0 in 0.537s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1afba7eb-37f8-412d-a9cf-115e645c07ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1d3b26-e268-41fb-b581-214361d6a9a1]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:42 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce Apr 14 03:03:42 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:42 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce" returned: 0 in 0.520s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:03:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:42 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 Apr 14 03:03:42 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:44 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" returned: 0 in 2.059s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:44 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[681af918-2ac6-4e19-bc3e-4f7e8f6523cf]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:45 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce Apr 14 03:03:45 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:45 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce" returned: 0 in 0.598s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:45 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce, size 1024.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:03:45 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Converted 1024.00 MB image at 497.17 MB/s Apr 14 03:03:45 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:03:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:45 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 Apr 14 03:03:45 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:46 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" returned: 0 in 0.451s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" released by "_copy_volume_from_snapshot" :: held 4.220s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-313cabe9-20ee-442d-8695-e67e2abe2e4a-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" released by "_create_volume_from_snapshot" :: held 4.240s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.257s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.150s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Creating offline snapshot 7a1b3869-5448-4c14-b806-97f353d3f127 of volume 5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[09558234-e5bc-41b4-9e9f-3fc038f68bc5]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:46 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-34606719-c969-4ed8-ad42-10419f0c2e5d tempest-GroupSnapshotsTest-719658903 None] Create group from source-snapshot-05f88a30-3e15-4c88-9354-a9fd08864a67 completed successfully. Apr 14 03:03:46 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa Apr 14 03:03:46 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:46 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa" returned: 0 in 0.525s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:46 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 1G Apr 14 03:03:46 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8de4e8-6239-4a05-84cd-541d51c810bc]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:46 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 Apr 14 03:03:46 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:47 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 1G" returned: 0 in 0.567s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:47 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 Apr 14 03:03:47 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:47 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" returned: 0 in 0.519s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:47 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228 Apr 14 03:03:47 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:47 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127" returned: 0 in 0.437s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:47 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 is being set with open permissions: ugo+rw Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:47 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 Apr 14 03:03:47 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:47 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" returned: 0 in 0.448s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-571f4e7d-0f7c-41f5-a0d2-b4e85e958228" released by "delete_volume" :: held 0.998s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Created reservations ['cb441562-064f-4734-a19d-b57e1e81b55a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:47 devstack cinder-volume[82473]: WARNING cinder.quota [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-779076200 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-779076200, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:03:47 devstack cinder-volume[82473]: WARNING cinder.quota [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-779076200 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-779076200, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Created reservations ['f546821f-9ad1-48b3-89f2-35e4434f828c', 'b628170e-491f-4142-ae35-b2e0cfae121a', '6bc33032-3276-429e-b287-f5c7de7211cd', '1dbbff37-6e15-4c84-ab45-396fe6796cfa'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:47 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:47 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:48 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127" returned: 0 in 0.458s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:48 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-96462c16-0f1e-49fe-ab16-901c039edb7d tempest-VolumesDeleteCascade-614937133 None] Create snapshot completed successfully Apr 14 03:03:48 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:48 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:48 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a324cc64-f06d-40ad-b4c5-6ac4d555630e tempest-GroupSnapshotsTest-719658903 None] Delete group completed successfully. Apr 14 03:03:48 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] group_snapshot 05f88a30-3e15-4c88-9354-a9fd08864a67: deleting Apr 14 03:03:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] group_snapshot 05f88a30-3e15-4c88-9354-a9fd08864a67: deleting {{(pid=82473) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 14 03:03:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-1afba7eb-37f8-412d-a9cf-115e645c07ce" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-1afba7eb-37f8-412d-a9cf-115e645c07ce" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-313cabe9-20ee-442d-8695-e67e2abe2e4a" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-313cabe9-20ee-442d-8695-e67e2abe2e4a" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Deleting offline snapshot 313cabe9-20ee-442d-8695-e67e2abe2e4a of volume 1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] snapshot_file for this snap is: volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c88138-817e-4064-b2ce-8bd7f0517aab]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:49 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a Apr 14 03:03:49 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-5b461bd9-2d60-4677-aafc-ba79b38fa5a0-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-5b461bd9-2d60-4677-aafc-ba79b38fa5a0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Performing cascade delete. {{(pid=82473) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-7a1b3869-5448-4c14-b806-97f353d3f127-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-7a1b3869-5448-4c14-b806-97f353d3f127-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-7a1b3869-5448-4c14-b806-97f353d3f127" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-7a1b3869-5448-4c14-b806-97f353d3f127" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Deleting offline snapshot 7a1b3869-5448-4c14-b806-97f353d3f127 of volume 5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] snapshot_file for this snap is: volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefbbbcb-df10-4884-8426-d4915ab5c8d0]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:49 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 Apr 14 03:03:49 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:49 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a" returned: 0 in 0.536s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1afba7eb-37f8-412d-a9cf-115e645c07ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[45717e08-b1ff-42cb-9673-6869916a5fe9]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:49 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce Apr 14 03:03:49 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:49 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127" returned: 0 in 0.506s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7eb547-783b-4538-97d8-f2dbee7239af]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:49 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa Apr 14 03:03:49 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:50 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:50 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a Apr 14 03:03:50 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:50 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa" returned: 0 in 0.491s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:50 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 Apr 14 03:03:50 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:50 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a" returned: 0 in 0.523s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:50 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a Apr 14 03:03:50 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:50 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127" returned: 0 in 0.520s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:50 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127 Apr 14 03:03:50 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:51 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce.313cabe9-20ee-442d-8695-e67e2abe2e4a" returned: 0 in 0.485s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-313cabe9-20ee-442d-8695-e67e2abe2e4a" released by "_delete_snapshot" :: held 2.083s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-1afba7eb-37f8-412d-a9cf-115e645c07ce" released by "delete_snapshot" :: held 2.093s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:51 devstack cinder-volume[82473]: WARNING cinder.quota [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-779076200 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-779076200, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] Created reservations ['f35d74c2-1737-4205-976e-3d17b94dd798', 'c6eade43-7edc-4af2-a030-f834ec52d7e7', '7ef9d535-f040-47cb-a2ca-f662663d4eed', '341ff1b7-7150-485a-a542-ed43d6dd54fd'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c1874b8a-21a1-43b1-b8a2-de2e8e2cc18b tempest-GroupSnapshotsTest-719658903 None] group_snapshot 05f88a30-3e15-4c88-9354-a9fd08864a67: deleted successfully Apr 14 03:03:51 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.7a1b3869-5448-4c14-b806-97f353d3f127" returned: 0 in 0.526s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-7a1b3869-5448-4c14-b806-97f353d3f127" released by "_delete_snapshot" :: held 2.090s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" released by "delete_snapshot" :: held 2.099s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Created reservations ['73960886-df64-41df-a756-01e8d822c7b8', '54e986f3-1637-4a85-a4cf-21f891e91c26', '47d110eb-a31d-4ef5-ab0e-f91f03ab4321', '377172f6-a7a6-4af3-8be6-5528b4c6ffab'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Delete snapshot completed successfully. Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-7a1b3869-5448-4c14-b806-97f353d3f127-delete_snapshot" released by "delete_snapshot" :: held 2.206s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-9730bd52-9091-4423-8315-2a14427dceaa-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-9730bd52-9091-4423-8315-2a14427dceaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-9730bd52-9091-4423-8315-2a14427dceaa" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-9730bd52-9091-4423-8315-2a14427dceaa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Deleting offline snapshot 9730bd52-9091-4423-8315-2a14427dceaa of volume 5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] snapshot_file for this snap is: volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eef072-9864-4bf1-802b-e3ea03852ad6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:51 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa Apr 14 03:03:51 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:51 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa" returned: 0 in 0.526s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeefbb3-d23b-45a2-b10a-ae9b601673ca]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:52 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 Apr 14 03:03:52 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-1afba7eb-37f8-412d-a9cf-115e645c07ce" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-1afba7eb-37f8-412d-a9cf-115e645c07ce" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:52 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[9915fa9a-f8a1-4261-bdd0-a2f068d2a1df]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:52 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce Apr 14 03:03:52 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:52 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" returned: 0 in 0.556s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:52 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa Apr 14 03:03:52 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:52 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce" returned: 0 in 0.483s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:52 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce Apr 14 03:03:52 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:53 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:53 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa Apr 14 03:03:53 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:53 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1afba7eb-37f8-412d-a9cf-115e645c07ce" returned: 0 in 0.407s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-1afba7eb-37f8-412d-a9cf-115e645c07ce" released by "delete_volume" :: held 0.930s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Created reservations ['9f8a595b-d87b-4e07-b4d6-5d072a4d528a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:53 devstack cinder-volume[82473]: WARNING cinder.db.sqlalchemy.api [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-779076200'] Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Created reservations ['95223a23-b0c0-45e8-a171-6b6ba69a66b5', '5977e221-0291-483b-9c20-0d716bce3777', '1a9d3ca1-2463-4755-a642-b41259c31348', '40bf37db-115b-4e32-a71c-f99bd8f96e95'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:53 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:53 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:53 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0.9730bd52-9091-4423-8315-2a14427dceaa" returned: 0 in 0.459s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-9730bd52-9091-4423-8315-2a14427dceaa" released by "_delete_snapshot" :: held 2.082s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" released by "delete_snapshot" :: held 2.100s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Created reservations ['d08e8688-9fb0-4d71-b7da-6e432e9ee4ea', '38037838-90df-40ce-b4b4-d439f030d715', 'ad20587a-6399-451a-9eb4-67f1a4fdee2a', '0ab90ab6-24f5-4bb6-ac84-d542a2b3193d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:53 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Delete snapshot completed successfully. Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-9730bd52-9091-4423-8315-2a14427dceaa-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Snapshots deleted, issuing volume delete {{(pid=82473) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[55563804-2af6-4bab-893e-1274e8d70264]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:53 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c696b0e8-6466-4af4-98de-c9fa448cde12 tempest-GroupSnapshotsTest-719658903 None] Group tempest-GroupSnapshotsTest-Group-1664111985: creating Apr 14 03:03:53 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 Apr 14 03:03:53 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:53 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c696b0e8-6466-4af4-98de-c9fa448cde12 tempest-GroupSnapshotsTest-719658903 None] Group tempest-GroupSnapshotsTest-Group-1664111985: created successfully Apr 14 03:03:53 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c696b0e8-6466-4af4-98de-c9fa448cde12 tempest-GroupSnapshotsTest-719658903 None] Create group completed successfully. Apr 14 03:03:53 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.503s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:53 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:53 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-918c46e3-6849-41bc-a036-007555d9012a tempest-GroupSnapshotsTest-719658903 None] Delete group completed successfully. Apr 14 03:03:54 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" returned: 0 in 0.530s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:54 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0 Apr 14 03:03:54 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:54 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-5b461bd9-2d60-4677-aafc-ba79b38fa5a0" released by "delete_volume" :: held 0.995s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Created reservations ['748af5c1-1320-4d15-8030-edc1cd656e76', 'd489bf93-29af-4cc1-8c57-e79458ac2312', '39c37f95-224b-45cf-9cbf-b1c6406b166c', '86d84757-ada0-4c4d-9e25-d3e60736d31d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:54 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:03:54 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Flow 'volume_create_manager' (66ad7e08-49ce-49e9-ac2e-26cfb79044c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95f4c52-7aa9-4d0b-8724-29507af721b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95f4c52-7aa9-4d0b-8724-29507af721b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102484670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=628a592a-62cc-40c8-b7e6-4c0498f7837f,host='devstack@QuobyteHD#QuobyteHD',id=bc550a1d-871f-48f4-bbc4-c66f743474e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f83ef39148c4c8f891ee5a0f5dfc046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:55Z,use_quota=True,user_id='3070afc3c0fb4f78b133ee43adb05d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45f0f801-6106-4c47-959f-b90cc8d2f24a),volume_type_id=45f0f801-6106-4c47-959f-b90cc8d2f24a)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fffb77-35ad-407a-b7ab-e99f662b7a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fffb77-35ad-407a-b7ab-e99f662b7a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640fc968-c2ea-441e-b5dc-f61ede864b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640fc968-c2ea-441e-b5dc-f61ede864b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc550a1d-871f-48f4-bbc4-c66f743474e6', 'volume_name': 'volume-bc550a1d-871f-48f4-bbc4-c66f743474e6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14e61fb-3eaa-4b3b-9ce6-0eed9898ceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14e61fb-3eaa-4b3b-9ce6-0eed9898ceb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6355c6-8f35-418f-95dd-0ce76c3c5ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Volume bc550a1d-871f-48f4-bbc4-c66f743474e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc550a1d-871f-48f4-bbc4-c66f743474e6', 'volume_size': 1} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=628a592a-62cc-40c8-b7e6-4c0498f7837f,created_at=2026-04-14T01:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102484670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=628a592a-62cc-40c8-b7e6-4c0498f7837f,host='devstack@QuobyteHD#QuobyteHD',id=bc550a1d-871f-48f4-bbc4-c66f743474e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f83ef39148c4c8f891ee5a0f5dfc046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:55Z,use_quota=True,user_id='3070afc3c0fb4f78b133ee43adb05d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45f0f801-6106-4c47-959f-b90cc8d2f24a),volume_type_id=45f0f801-6106-4c47-959f-b90cc8d2f24a)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Creating volume bc550a1d-871f-48f4-bbc4-c66f743474e6 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:55 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:55 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 1073741824 Apr 14 03:03:55 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:55 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.485s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:03:55 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Deleted volume successfully. Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-68801535-3970-4f55-b0ae-256a4094e58b tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-5b461bd9-2d60-4677-aafc-ba79b38fa5a0-delete_volume" released by "delete_volume" :: held 6.057s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:55 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 1073741824" returned: 0 in 0.512s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:55 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 Apr 14 03:03:55 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Flow 'volume_create_manager' (8bdbb4ff-4a9d-41e6-8074-1dbb8f326a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15804b72-980a-45b4-8d16-c78d2b496fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15804b72-980a-45b4-8d16-c78d2b496fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2014129307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027b950c-cf79-4d8f-812b-0a08ead405b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb3ecee21ea4e8a82a8d477a2e207c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:56Z,use_quota=True,user_id='f96baf4b72da4974bac91489a5778276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7805a2eb-84c2-4331-a391-2960ac598d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7805a2eb-84c2-4331-a391-2960ac598d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7a27b5-9ce0-4f87-a548-468b87f985c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7a27b5-9ce0-4f87-a548-468b87f985c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027b950c-cf79-4d8f-812b-0a08ead405b1', 'volume_name': 'volume-027b950c-cf79-4d8f-812b-0a08ead405b1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b271e72d-7603-4bba-b639-c87225929954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b271e72d-7603-4bba-b639-c87225929954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabb2f76-1226-4bfd-9145-f7febbfe1ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:55 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Volume 027b950c-cf79-4d8f-812b-0a08ead405b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027b950c-cf79-4d8f-812b-0a08ead405b1', 'volume_size': 1} Apr 14 03:03:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:56 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6" returned: 0 in 0.417s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2014129307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027b950c-cf79-4d8f-812b-0a08ead405b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb3ecee21ea4e8a82a8d477a2e207c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:56Z,use_quota=True,user_id='f96baf4b72da4974bac91489a5778276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Creating volume 027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:56 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6355c6-8f35-418f-95dd-0ce76c3c5ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc550a1d-871f-48f4-bbc4-c66f743474e6', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958a9eea-309f-4ae8-ab9d-90f075179326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:56 devstack sudo[87355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 1073741824 Apr 14 03:03:56 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:56 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Volume volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 (bc550a1d-871f-48f4-bbc4-c66f743474e6): created successfully Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958a9eea-309f-4ae8-ab9d-90f075179326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Flow 'volume_create_manager' (66ad7e08-49ce-49e9-ac2e-26cfb79044c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:56 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-43f1048c-3766-452c-8509-e3c65b924ff8 tempest-GroupSnapshotsTest-719658903 None] Created volume successfully. Apr 14 03:03:56 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 1073741824" returned: 0 in 0.653s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:56 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 Apr 14 03:03:56 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:57 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1" returned: 0 in 0.489s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabb2f76-1226-4bfd-9145-f7febbfe1ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027b950c-cf79-4d8f-812b-0a08ead405b1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b0e414-3bb2-4596-982c-6c26c0f5beb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:57 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Volume volume-027b950c-cf79-4d8f-812b-0a08ead405b1 (027b950c-cf79-4d8f-812b-0a08ead405b1): created successfully Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b0e414-3bb2-4596-982c-6c26c0f5beb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Flow 'volume_create_manager' (8bdbb4ff-4a9d-41e6-8074-1dbb8f326a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-76ed8b12-99a7-4caa-b93a-aa7d20e90733 tempest-VolumesDeleteCascade-614937133 None] Created volume successfully. Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Flow 'volume_create_manager' (7fd133a1-c9e4-42d9-9341-e9d5e47972dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e4b80f-5932-4446-ad86-e12fcb8bc75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e4b80f-5932-4446-ad86-e12fcb8bc75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364942363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=628a592a-62cc-40c8-b7e6-4c0498f7837f,host='devstack@QuobyteHD#QuobyteHD',id=a7d5c422-80b2-45fe-b907-b4edfe58b1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f83ef39148c4c8f891ee5a0f5dfc046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:57Z,use_quota=True,user_id='3070afc3c0fb4f78b133ee43adb05d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45f0f801-6106-4c47-959f-b90cc8d2f24a),volume_type_id=45f0f801-6106-4c47-959f-b90cc8d2f24a)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0309882b-b369-4342-89a9-e6e0f249dcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0309882b-b369-4342-89a9-e6e0f249dcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa3b306-9c50-4a4e-b67e-d99df291edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa3b306-9c50-4a4e-b67e-d99df291edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d5c422-80b2-45fe-b907-b4edfe58b1b4', 'volume_name': 'volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801f3143-ee4d-46ce-9a87-e010c2e1e334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801f3143-ee4d-46ce-9a87-e010c2e1e334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d06a54-75e9-4746-afb7-1a9509c59850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:57 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Volume a7d5c422-80b2-45fe-b907-b4edfe58b1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4', 'volume_size': 1} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=628a592a-62cc-40c8-b7e6-4c0498f7837f,created_at=2026-04-14T01:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364942363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=628a592a-62cc-40c8-b7e6-4c0498f7837f,host='devstack@QuobyteHD#QuobyteHD',id=a7d5c422-80b2-45fe-b907-b4edfe58b1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f83ef39148c4c8f891ee5a0f5dfc046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:03:57Z,use_quota=True,user_id='3070afc3c0fb4f78b133ee43adb05d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45f0f801-6106-4c47-959f-b90cc8d2f24a),volume_type_id=45f0f801-6106-4c47-959f-b90cc8d2f24a)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Creating volume a7d5c422-80b2-45fe-b907-b4edfe58b1b4 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:03:57 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:03:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:57 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 1073741824 Apr 14 03:03:57 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:03:58 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 1073741824" returned: 0 in 0.561s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:58 devstack sudo[87397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 Apr 14 03:03:58 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:58 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" returned: 0 in 0.428s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.582s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Creating offline snapshot b1a14a1b-bf42-4d30-861f-9a74a97852df of volume 027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d06a54-75e9-4746-afb7-1a9509c59850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b99847-0e7f-45e6-9b35-b080b50e917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d844a6-d0d1-41bf-b49d-f9be1a3b0179]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:58 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Volume volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 (a7d5c422-80b2-45fe-b907-b4edfe58b1b4): created successfully Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b99847-0e7f-45e6-9b35-b080b50e917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Flow 'volume_create_manager' (7fd133a1-c9e4-42d9-9341-e9d5e47972dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:03:58 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-daaf7f98-a541-4034-af2d-bf89863c0e3d tempest-GroupSnapshotsTest-719658903 None] Created volume successfully. Apr 14 03:03:58 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 Apr 14 03:03:58 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a8acfc57-f8c8-4cb6-a03e-89b318100b5b tempest-VolumesActionsTest-1322041277 None] Acquiring lock "cinder-665d60af-6ec7-491c-af15-17845671ea70" by "attach_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a8acfc57-f8c8-4cb6-a03e-89b318100b5b tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70" acquired by "attach_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:58 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a8acfc57-f8c8-4cb6-a03e-89b318100b5b tempest-VolumesActionsTest-1322041277 None] Attaching volume 665d60af-6ec7-491c-af15-17845671ea70 to instance f51e524d-629b-4176-ab36-83aaa3a7208b at mountpoint /dev/vdb on host None. Apr 14 03:03:58 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a8acfc57-f8c8-4cb6-a03e-89b318100b5b tempest-VolumesActionsTest-1322041277 None] Attach volume completed successfully. Apr 14 03:03:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a8acfc57-f8c8-4cb6-a03e-89b318100b5b tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70" released by "attach_volume" :: held 0.054s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:59 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1" returned: 0 in 0.563s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:59 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df 1G Apr 14 03:03:59 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-036a2d6e-93b3-49cf-b9df-ec2161daf472 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-detach_volume" by "detach_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:03:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-036a2d6e-93b3-49cf-b9df-ec2161daf472 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:03:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-036a2d6e-93b3-49cf-b9df-ec2161daf472 tempest-VolumesActionsTest-1322041277 None] Detaching volume 665d60af-6ec7-491c-af15-17845671ea70 from instance f51e524d-629b-4176-ab36-83aaa3a7208b. Apr 14 03:03:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-036a2d6e-93b3-49cf-b9df-ec2161daf472 tempest-VolumesActionsTest-1322041277 None] Detach volume completed successfully. Apr 14 03:03:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-036a2d6e-93b3-49cf-b9df-ec2161daf472 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:03:59 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 14 03:03:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df 1G" returned: 0 in 0.506s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:03:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027b950c-cf79-4d8f-812b-0a08ead405b1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:03:59 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027b950c-cf79-4d8f-812b-0a08ead405b1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df Apr 14 03:03:59 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:03:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e5370cda-a97a-4406-9d8e-a48f9d886a67 tempest-GroupSnapshotsTest-719658903 None] Update group completed successfully. Apr 14 03:04:00 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-027b950c-cf79-4d8f-812b-0a08ead405b1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df" returned: 0 in 0.528s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:00 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df is being set with open permissions: ugo+rw Apr 14 03:04:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:00 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df Apr 14 03:04:00 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:00 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df" returned: 0 in 0.401s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:00 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.info Apr 14 03:04:00 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:01 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f8635c23-7bd8-4d35-b6ed-e1d8b80fdedc tempest-GroupSnapshotsTest-719658903 None] Update group completed successfully. Apr 14 03:04:01 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.info" returned: 0 in 0.481s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:01 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.info is being set with open permissions: ugo+rw Apr 14 03:04:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:01 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.info Apr 14 03:04:01 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:01 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.info" returned: 0 in 0.402s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:01 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5e9de347-15da-4821-95f5-0ebf0ca2d83a tempest-VolumesDeleteCascade-614937133 None] Create snapshot completed successfully Apr 14 03:04:02 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-fa93664e-41cc-4115-bf53-061e49c1810a tempest-GroupSnapshotsTest-719658903 None] Update group completed successfully. Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Flow 'volume_create_manager' (eccb2e34-c024-4ae4-bd68-fa0b32d86b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fefb400-16c9-4432-b160-d8498cca6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fefb400-16c9-4432-b160-d8498cca6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-550471872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77d8f51-652e-4685-a783-a49e9af32c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb3ecee21ea4e8a82a8d477a2e207c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1a14a1b-bf42-4d30-861f-9a74a97852df,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:03Z,use_quota=True,user_id='f96baf4b72da4974bac91489a5778276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787e882d-f737-4ef2-922c-7e4c4cdb9f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787e882d-f737-4ef2-922c-7e4c4cdb9f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9619c6fa-36bb-473a-bf9c-56293f313dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9619c6fa-36bb-473a-bf9c-56293f313dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c77d8f51-652e-4685-a783-a49e9af32c1a', 'volume_name': 'volume-c77d8f51-652e-4685-a783-a49e9af32c1a', 'volume_size': 1, 'snapshot_id': 'b1a14a1b-bf42-4d30-861f-9a74a97852df'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c1e617-aa2d-47e5-bef8-95673769a83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c1e617-aa2d-47e5-bef8-95673769a83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f61660-0162-4ff8-adb5-990f173371a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:02 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Volume c77d8f51-652e-4685-a783-a49e9af32c1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c77d8f51-652e-4685-a783-a49e9af32c1a', 'volume_size': 1, 'snapshot_id': 'b1a14a1b-bf42-4d30-861f-9a74a97852df'} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-b1a14a1b-bf42-4d30-861f-9a74a97852df-c77d8f51-652e-4685-a783-a49e9af32c1a" by "_create_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-b1a14a1b-bf42-4d30-861f-9a74a97852df-c77d8f51-652e-4685-a783-a49e9af32c1a" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Creating volume c77d8f51-652e-4685-a783-a49e9af32c1a from snapshot b1a14a1b-bf42-4d30-861f-9a74a97852df {{(pid=82473) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-c77d8f51-652e-4685-a783-a49e9af32c1a" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-c77d8f51-652e-4685-a783-a49e9af32c1a" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] snapshot: b1a14a1b-bf42-4d30-861f-9a74a97852df, volume: c77d8f51-652e-4685-a783-a49e9af32c1a, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[536e0a82-eb36-47bf-aa6c-2b08e5bf19b6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:02 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df Apr 14 03:04:02 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:03 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-027b950c-cf79-4d8f-812b-0a08ead405b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[842adb40-ab94-48d4-a333-afb781ac2c33]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:03 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 Apr 14 03:04:03 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:03 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f1fa7346-9a58-4237-b6d2-acc0d1c11204 tempest-GroupSnapshotsTest-719658903 None] Update group completed successfully. Apr 14 03:04:03 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1" returned: 0 in 0.498s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:04:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:03 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a Apr 14 03:04:03 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:04 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] GroupSnapshot 45c6e294-b090-42c4-b09c-5097a87d018c: creating. Apr 14 03:04:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Group snapshot 45c6e294-b090-42c4-b09c-5097a87d018c: creating. {{(pid=82473) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 14 03:04:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:05 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a" returned: 0 in 2.084s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:05 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de0632-2b67-4700-8c00-4fc7223b8791]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:05 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 Apr 14 03:04:05 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:06 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1" returned: 0 in 0.625s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:04:06 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Converted 1024.00 MB image at 491.12 MB/s Apr 14 03:04:06 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a is being set with open permissions: ugo+rw Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:06 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a Apr 14 03:04:06 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:06 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a" returned: 0 in 0.460s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-c77d8f51-652e-4685-a783-a49e9af32c1a" released by "_copy_volume_from_snapshot" :: held 4.187s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-b1a14a1b-bf42-4d30-861f-9a74a97852df-c77d8f51-652e-4685-a783-a49e9af32c1a" released by "_create_volume_from_snapshot" :: held 4.202s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.211s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Creating offline snapshot 32c239b8-72bd-4fd3-a669-89902a24e276 of volume a7d5c422-80b2-45fe-b907-b4edfe58b1b4 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f61660-0162-4ff8-adb5-990f173371a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77d8f51-652e-4685-a783-a49e9af32c1a', 'volume_size': 1, 'snapshot_id': 'b1a14a1b-bf42-4d30-861f-9a74a97852df'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b520cb2-e45e-439a-8bd4-5907343aa640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf75889-a343-4107-b0bf-68b1f766d5ff]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:06 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Volume volume-c77d8f51-652e-4685-a783-a49e9af32c1a (c77d8f51-652e-4685-a783-a49e9af32c1a): created successfully Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b520cb2-e45e-439a-8bd4-5907343aa640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:06 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Flow 'volume_create_manager' (eccb2e34-c024-4ae4-bd68-fa0b32d86b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:06 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9646c34e-65cb-4628-9e49-cb6066d2ac1d tempest-VolumesDeleteCascade-614937133 None] Created volume successfully. Apr 14 03:04:06 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 Apr 14 03:04:06 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:07 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" returned: 0 in 0.470s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:07 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 1G Apr 14 03:04:07 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:07 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 1G" returned: 0 in 0.488s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:07 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 Apr 14 03:04:07 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-027b950c-cf79-4d8f-812b-0a08ead405b1-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-027b950c-cf79-4d8f-812b-0a08ead405b1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Performing cascade delete. {{(pid=82473) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-b1a14a1b-bf42-4d30-861f-9a74a97852df-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-b1a14a1b-bf42-4d30-861f-9a74a97852df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-027b950c-cf79-4d8f-812b-0a08ead405b1" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-027b950c-cf79-4d8f-812b-0a08ead405b1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-b1a14a1b-bf42-4d30-861f-9a74a97852df" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-b1a14a1b-bf42-4d30-861f-9a74a97852df" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Deleting offline snapshot b1a14a1b-bf42-4d30-861f-9a74a97852df of volume 027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:04:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] snapshot_file for this snap is: volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[693e5b7d-c4e9-4a90-8ee5-154fd3ac1a20]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:08 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df Apr 14 03:04:08 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:08 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276" returned: 0 in 0.468s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:08 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:08 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 Apr 14 03:04:08 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:08 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-027b950c-cf79-4d8f-812b-0a08ead405b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1646109c-db47-45e0-b1ca-fcfcde3855b5]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:08 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 Apr 14 03:04:08 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:08 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276" returned: 0 in 0.403s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:08 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.info Apr 14 03:04:08 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:08 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1" returned: 0 in 0.466s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:08 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df Apr 14 03:04:08 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:09 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.info" returned: 0 in 0.415s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:09 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:09 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.info Apr 14 03:04:09 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:09 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:09 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df Apr 14 03:04:09 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:09 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.info" returned: 0 in 0.413s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.726s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Creating offline snapshot ac92d2b5-15ef-43a9-bf77-5ddc198da86a of volume bc550a1d-871f-48f4-bbc4-c66f743474e6 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[18111295-ac87-46c0-87da-cee300a59f74]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:09 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 Apr 14 03:04:09 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:09 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1.b1a14a1b-bf42-4d30-861f-9a74a97852df" returned: 0 in 0.402s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-b1a14a1b-bf42-4d30-861f-9a74a97852df" released by "_delete_snapshot" :: held 1.849s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-027b950c-cf79-4d8f-812b-0a08ead405b1" released by "delete_snapshot" :: held 1.863s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Created reservations ['381e482b-cf82-43fb-887c-3d795cf04a5b', '1afe2ad6-59fa-4574-baee-283df93f9a69', 'abb104e0-18c4-40f6-bd0d-6f7147a494be', 'fc6fbba0-e3f4-4c64-b489-43ee1455d7f4'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:09 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Delete snapshot completed successfully. Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-b1a14a1b-bf42-4d30-861f-9a74a97852df-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Snapshots deleted, issuing volume delete {{(pid=82473) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-027b950c-cf79-4d8f-812b-0a08ead405b1" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-027b950c-cf79-4d8f-812b-0a08ead405b1" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[911d2ae5-12e3-41e6-89f8-6dc034b12eb4]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:10 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 Apr 14 03:04:10 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:10 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6" returned: 0 in 0.500s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:10 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a 1G Apr 14 03:04:10 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:10 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1" returned: 0 in 0.547s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:10 devstack sudo[87540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1 Apr 14 03:04:10 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:10 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a 1G" returned: 0 in 0.476s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:10 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a Apr 14 03:04:10 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:10 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-027b950c-cf79-4d8f-812b-0a08ead405b1" returned: 0 in 0.431s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-027b950c-cf79-4d8f-812b-0a08ead405b1" released by "delete_volume" :: held 1.009s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:10 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a" returned: 0 in 0.427s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:10 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:10 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Created reservations ['5e8ef657-9e48-4f61-83c2-9d7d82848c5d', '471a2557-01c6-4fb2-a0cb-c9cab67847c1', '3a8ae7e2-e498-4ff4-a085-2e7e03ef376e', '835d05ca-2230-4984-b7c2-2495b80c67a1'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:10 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a Apr 14 03:04:10 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:11 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:11 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-c77d8f51-652e-4685-a783-a49e9af32c1a-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-c77d8f51-652e-4685-a783-a49e9af32c1a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "cinder-quobyte-c77d8f51-652e-4685-a783-a49e9af32c1a" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-c77d8f51-652e-4685-a783-a49e9af32c1a" acquired by "delete_volume" :: waited 0.019s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1130d5d0-a411-4924-bb99-f5294bc3866d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:11 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a Apr 14 03:04:11 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:11 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a" returned: 0 in 0.406s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:11 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.info Apr 14 03:04:11 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:11 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.504s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:11 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Deleted volume successfully. Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7afb5c12-e96b-4388-bdc4-eba1bb33f385 tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-027b950c-cf79-4d8f-812b-0a08ead405b1-delete_volume" released by "delete_volume" :: held 3.622s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:11 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a" returned: 0 in 0.489s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:11 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a Apr 14 03:04:11 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:11 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.info" returned: 0 in 0.424s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:11 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:04:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:11 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.info Apr 14 03:04:11 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:12 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c77d8f51-652e-4685-a783-a49e9af32c1a" returned: 0 in 0.420s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-quobyte-c77d8f51-652e-4685-a783-a49e9af32c1a" released by "delete_volume" :: held 0.931s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Created reservations ['c3b8d212-939f-42d7-b2fa-67b6b75986ad', 'fdd861c4-a019-492d-8585-ed43eb9ba0b5', '0422ce3b-d2d5-4c18-88e2-609446c0c127', '3a2b77e1-4b1c-4062-b0bc-a8546a6a288d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:12 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.info" returned: 0 in 0.427s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.220s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f60b2c2-9af9-408c-a695-9bdc0ad3dee7]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:12 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:12 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:12 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:04:12 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:12 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e56e090b-1a04-4278-90d8-fdb80b123c37 tempest-GroupSnapshotsTest-719658903 None] group_snapshot 45c6e294-b090-42c4-b09c-5097a87d018c: created successfully Apr 14 03:04:12 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:12 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Deleted volume successfully. Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0378abb8-7ce9-4a94-8719-e14471882f1e tempest-VolumesDeleteCascade-614937133 None] Lock "cinder-c77d8f51-652e-4685-a783-a49e9af32c1a-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:12 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.593s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[95926205-6f1a-4e1b-acf2-01e1bcaec796]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:12 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:04:12 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:13 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] group_snapshot 45c6e294-b090-42c4-b09c-5097a87d018c: deleting Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] group_snapshot 45c6e294-b090-42c4-b09c-5097a87d018c: deleting {{(pid=82473) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-32c239b8-72bd-4fd3-a669-89902a24e276" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-32c239b8-72bd-4fd3-a669-89902a24e276" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Deleting offline snapshot 32c239b8-72bd-4fd3-a669-89902a24e276 of volume a7d5c422-80b2-45fe-b907-b4edfe58b1b4 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] snapshot_file for this snap is: volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d25fde-26ac-479b-887e-99390fbcfa7f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:13 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 Apr 14 03:04:13 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:13 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.607s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.f09214dc-ef6e-4b70-b5ac-bf9487c659ff8c_e_uw2.img {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:13 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.f09214dc-ef6e-4b70-b5ac-bf9487c659ff8c_e_uw2.img Apr 14 03:04:13 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:13 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276" returned: 0 in 0.544s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[613cd95e-3799-4e53-904a-8dc9147613a4]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:13 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 Apr 14 03:04:13 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=149,cinder:UPDATE=112,cinder:INSERT=47,cinder:DELETE=13 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Flow 'volume_create_manager' (3ba784d5-0280-41e1-99ae-62e2dec62cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490dfc01-279a-42d3-aa13-2082e8657880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:14 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:14 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490dfc01-279a-42d3-aa13-2082e8657880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1175619235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967f9a3a-486b-4a74-844d-d7075aab9b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2008ee96fdf042419287515e2183ee1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:15Z,use_quota=True,user_id='d1a90d3065dd45bd9361961de35130af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96f51c6-af63-4057-9150-c4c9f847ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96f51c6-af63-4057-9150-c4c9f847ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560f0292-3a0f-4f53-91fa-8325e239e605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560f0292-3a0f-4f53-91fa-8325e239e605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967f9a3a-486b-4a74-844d-d7075aab9b59', 'volume_name': 'volume-967f9a3a-486b-4a74-844d-d7075aab9b59', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2b269e-bbfc-421e-b548-f396c4f8e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2b269e-bbfc-421e-b548-f396c4f8e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7986ca7-6680-41f4-a4db-af816b04893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:15 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Volume 967f9a3a-486b-4a74-844d-d7075aab9b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967f9a3a-486b-4a74-844d-d7075aab9b59', 'volume_size': 1} Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:15 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" returned: 0 in 1.264s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:15 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 Apr 14 03:04:15 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:15 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.f09214dc-ef6e-4b70-b5ac-bf9487c659ff8c_e_uw2.img" returned: 0 in 2.292s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e27ec-aa8c-4d86-adb1-ce11a165185c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:15 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 1.088s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:15 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:04:15 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:15 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276" returned: 0 in 0.824s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:15 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276 Apr 14 03:04:15 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:16 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4.32c239b8-72bd-4fd3-a669-89902a24e276" returned: 0 in 0.399s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-32c239b8-72bd-4fd3-a669-89902a24e276" released by "_delete_snapshot" :: held 3.083s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" released by "delete_snapshot" :: held 3.103s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-bc550a1d-871f-48f4-bbc4-c66f743474e6" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-bc550a1d-871f-48f4-bbc4-c66f743474e6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-ac92d2b5-15ef-43a9-bf77-5ddc198da86a" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-ac92d2b5-15ef-43a9-bf77-5ddc198da86a" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Deleting offline snapshot ac92d2b5-15ef-43a9-bf77-5ddc198da86a of volume bc550a1d-871f-48f4-bbc4-c66f743474e6 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] snapshot_file for this snap is: volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97b9df2-81cc-45b0-b3fd-0971e458f6e3]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:16 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.627s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.f09214dc-ef6e-4b70-b5ac-bf9487c659ff8c_e_uw2.img {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:04:16 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Converted 1024.00 MB image at 446.53 MB/s Apr 14 03:04:16 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a Apr 14 03:04:16 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] f09214dc-ef6e-4b70-b5ac-bf9487c659ff was raw, no need to convert to raw {{(pid=82473) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 14 03:04:16 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a" returned: 0 in 0.515s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc550a1d-871f-48f4-bbc4-c66f743474e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[2866c265-8aa1-4d13-bd68-37610f734eb6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:16 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 Apr 14 03:04:16 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:17 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6" returned: 0 in 0.531s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:17 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a Apr 14 03:04:17 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:17 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a" returned: 0 in 0.529s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:17 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a Apr 14 03:04:17 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:18 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6.ac92d2b5-15ef-43a9-bf77-5ddc198da86a" returned: 0 in 0.507s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-ac92d2b5-15ef-43a9-bf77-5ddc198da86a" released by "_delete_snapshot" :: held 2.139s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-bc550a1d-871f-48f4-bbc4-c66f743474e6" released by "delete_snapshot" :: held 2.151s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:18 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=166,cinder:UPDATE=173,cinder:INSERT=34,cinder:DELETE=5 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:04:18 devstack cinder-volume[82473]: WARNING cinder.quota [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-656758540 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-656758540, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:04:18 devstack cinder-volume[82473]: WARNING cinder.quota [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-656758540 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-656758540, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:04:18 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Created reservations ['5b3c7669-57ca-4129-9b9d-0f0da4222ce2', 'd1f79482-0afd-4342-a97e-8aa5b5e0f280', '7b8a4b7a-e8fd-4cce-a730-41eb8e2e86db', '0fc57dc5-b096-42f5-ac02-df6a88609257'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:18 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] Created reservations ['9216f847-e6b9-4307-b8bc-9686bbfee77b', '3934bb21-46f9-40b6-a4dd-4c0e77e12da1', '85f07491-c21c-4e1e-a539-87923c252288', '29f1c1f0-a8b7-486b-af01-775918887e0f'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:18 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a1234b72-b149-4984-af76-b2ffd996ee4c tempest-GroupSnapshotsTest-719658903 None] group_snapshot 45c6e294-b090-42c4-b09c-5097a87d018c: deleted successfully Apr 14 03:04:19 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:19 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:19 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af6b233-f73d-486f-8c69-8335f5e55751]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:19 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 Apr 14 03:04:19 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:20 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" returned: 0 in 0.552s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:20 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4 Apr 14 03:04:20 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:20 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-a7d5c422-80b2-45fe-b907-b4edfe58b1b4" released by "delete_volume" :: held 1.063s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-bc550a1d-871f-48f4-bbc4-c66f743474e6" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-bc550a1d-871f-48f4-bbc4-c66f743474e6" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ed9bb-5f52-4b1d-906f-8754ae1d4d98]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:20 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 Apr 14 03:04:20 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:21 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6" returned: 0 in 0.558s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:21 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6 Apr 14 03:04:21 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:21 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bc550a1d-871f-48f4-bbc4-c66f743474e6" returned: 0 in 0.523s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-bc550a1d-871f-48f4-bbc4-c66f743474e6" released by "delete_volume" :: held 1.114s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Created reservations ['2ef77b73-6481-4e8c-b00c-521f4eac9cd7'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:22 devstack cinder-volume[82473]: WARNING cinder.quota [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-656758540 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-656758540, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Created reservations ['f64206dd-51ef-4430-9aee-98b9fc98721f', '38169511-9cbc-487a-a886-bdc8dbd3a803', '39109a2e-f764-430d-a573-ad520cdc9abc', 'fcd49185-32d5-4d20-b934-4aa1b2e386b6'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Created reservations ['b24fa343-dbde-45d7-9b95-6e12f1bacdbb', 'd56cb07d-2f3e-434c-8b66-d7e6485a05c1', '20fdfea9-793e-4b87-91b1-f4b8149dbccd', 'a336f6ec-f515-47bf-8805-fc7c96245794'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:22 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:22 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:22 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.494s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:22 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:22 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5aecfbd4-8188-4703-93bc-13a88187f3e8 tempest-GroupSnapshotsTest-719658903 None] Delete group completed successfully. Apr 14 03:04:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-54640ecc-f4e4-4d67-9bb1-12377adda17b tempest-GroupSnapshotsTest-719658903 None] Group tempest-GroupSnapshotsTest-Group-1685654600: creating Apr 14 03:04:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-54640ecc-f4e4-4d67-9bb1-12377adda17b tempest-GroupSnapshotsTest-719658903 None] Group tempest-GroupSnapshotsTest-Group-1685654600: created successfully Apr 14 03:04:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-54640ecc-f4e4-4d67-9bb1-12377adda17b tempest-GroupSnapshotsTest-719658903 None] Create group completed successfully. Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Flow 'volume_create_manager' (e1286f6c-dd93-47c7-a137-034e0a2abdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ea49e5-dc10-4721-82d0-30bc6b11afcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ea49e5-dc10-4721-82d0-30bc6b11afcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1940680746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90e0f1a4-d3c6-4eae-8d5b-b7dd7becb69a,host='devstack@QuobyteHD#QuobyteHD',id=897f6298-580e-467f-898e-b530f15fe6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f83ef39148c4c8f891ee5a0f5dfc046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:25Z,use_quota=True,user_id='3070afc3c0fb4f78b133ee43adb05d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(870999b4-44a8-4ff3-83d3-27ba71980c51),volume_type_id=870999b4-44a8-4ff3-83d3-27ba71980c51)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8eab0d-6a15-490e-83b1-da37822a4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8eab0d-6a15-490e-83b1-da37822a4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f55d569-fc4f-4440-973c-781485ae4e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f55d569-fc4f-4440-973c-781485ae4e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897f6298-580e-467f-898e-b530f15fe6d1', 'volume_name': 'volume-897f6298-580e-467f-898e-b530f15fe6d1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc03eea4-dcde-414f-8c64-a3b270417c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc03eea4-dcde-414f-8c64-a3b270417c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d760e-c7dd-4800-8254-2e841b205b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:24 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Volume 897f6298-580e-467f-898e-b530f15fe6d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897f6298-580e-467f-898e-b530f15fe6d1', 'volume_size': 1} Apr 14 03:04:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.921s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Uploaded volume to glance image-id: f09214dc-ef6e-4b70-b5ac-bf9487c659ff. {{(pid=82473) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.190s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1175619235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967f9a3a-486b-4a74-844d-d7075aab9b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2008ee96fdf042419287515e2183ee1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:15Z,use_quota=True,user_id='d1a90d3065dd45bd9361961de35130af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Creating volume 967f9a3a-486b-4a74-844d-d7075aab9b59 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:04:26 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:26 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 1073741824 Apr 14 03:04:26 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:26 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e6b38000-1b59-4789-a152-454471a23a3e tempest-VolumesActionsTest-1322041277 None] Copy volume to image completed successfully. Apr 14 03:04:26 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 1073741824" returned: 0 in 0.559s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:26 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 Apr 14 03:04:26 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:27 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59" returned: 0 in 0.529s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.378s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=90e0f1a4-d3c6-4eae-8d5b-b7dd7becb69a,created_at=2026-04-14T01:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1940680746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=90e0f1a4-d3c6-4eae-8d5b-b7dd7becb69a,host='devstack@QuobyteHD#QuobyteHD',id=897f6298-580e-467f-898e-b530f15fe6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f83ef39148c4c8f891ee5a0f5dfc046',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:25Z,use_quota=True,user_id='3070afc3c0fb4f78b133ee43adb05d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(870999b4-44a8-4ff3-83d3-27ba71980c51),volume_type_id=870999b4-44a8-4ff3-83d3-27ba71980c51)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Creating volume 897f6298-580e-467f-898e-b530f15fe6d1 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:04:27 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7986ca7-6680-41f4-a4db-af816b04893c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967f9a3a-486b-4a74-844d-d7075aab9b59', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f925a4a-d062-4e35-9183-d362b7f88641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:27 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 1073741824 Apr 14 03:04:27 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:27 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Volume volume-967f9a3a-486b-4a74-844d-d7075aab9b59 (967f9a3a-486b-4a74-844d-d7075aab9b59): created successfully Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f925a4a-d062-4e35-9183-d362b7f88641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Flow 'volume_create_manager' (3ba784d5-0280-41e1-99ae-62e2dec62cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-483cc8b5-2b29-4c34-9317-20922db092ca tempest-VolumesMetadataTest-1220140064 None] Created volume successfully. Apr 14 03:04:27 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 1073741824" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:27 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 Apr 14 03:04:27 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:28 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1" returned: 0 in 0.456s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.012s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d760e-c7dd-4800-8254-2e841b205b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897f6298-580e-467f-898e-b530f15fe6d1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fa11d1-0682-4b9a-a911-64fd9b9a7aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8369291-29a0-461a-84f7-4f2e52c0e30b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:28 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Volume volume-897f6298-580e-467f-898e-b530f15fe6d1 (897f6298-580e-467f-898e-b530f15fe6d1): created successfully Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fa11d1-0682-4b9a-a911-64fd9b9a7aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Flow 'volume_create_manager' (e1286f6c-dd93-47c7-a137-034e0a2abdb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:28 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6b21adad-de52-4f96-b0d6-02914d4c4851 tempest-GroupSnapshotsTest-719658903 None] Created volume successfully. Apr 14 03:04:28 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:04:28 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Acquiring lock "cinder-967f9a3a-486b-4a74-844d-d7075aab9b59-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Lock "cinder-967f9a3a-486b-4a74-844d-d7075aab9b59-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Acquiring lock "cinder-quobyte-967f9a3a-486b-4a74-844d-d7075aab9b59" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Lock "cinder-quobyte-967f9a3a-486b-4a74-844d-d7075aab9b59" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5769a-21a2-4aa5-b465-4cd09db6964a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:28 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 Apr 14 03:04:28 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:28 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.572s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a8b87-4d0b-485c-bad6-9c79025901a1]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:28 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:04:28 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:29 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] GroupSnapshot 30d80424-0c02-4ce0-88d8-cbed23455070: creating. Apr 14 03:04:29 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59" returned: 0 in 0.577s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Group snapshot 30d80424-0c02-4ce0-88d8-cbed23455070: creating. {{(pid=82473) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:29 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59 Apr 14 03:04:29 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:29 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.548s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:29 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img Apr 14 03:04:29 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:29 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-967f9a3a-486b-4a74-844d-d7075aab9b59" returned: 0 in 0.435s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Lock "cinder-quobyte-967f9a3a-486b-4a74-844d-d7075aab9b59" released by "delete_volume" :: held 1.044s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:29 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Created reservations ['e7c2da2f-71d4-4ae9-9ee5-a2797475adb1', '3900470f-8512-466b-ab65-e58435eb9d25', '6e9bac25-4016-432f-ab78-2b75a0fd59ca', 'e80fc62a-55a2-4f01-a31c-fef2a21f23a3'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:30 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:30 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:31 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 1.461s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:31 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Deleted volume successfully. Apr 14 03:04:31 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img" returned: 0 in 2.150s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:31 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e17419b-a22a-4c7f-86f5-32eaaa2a511a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:31 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:04:31 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67e99a60-39b9-4edb-b45e-9703fe2fd5eb tempest-VolumesMetadataTest-1220140064 None] Lock "cinder-967f9a3a-486b-4a74-844d-d7075aab9b59-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:32 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.674s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:32 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:04:32 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Converted 1024.00 MB image at 476.17 MB/s Apr 14 03:04:32 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] 6c773677-a3e1-4167-b866-1b7fbffbe883 was raw, converting to qcow2 {{(pid=82473) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 14 03:04:32 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[860b07d3-66b1-4d6d-a890-004d2a8d5b39]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:32 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img Apr 14 03:04:32 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:32 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img" returned: 0 in 0.571s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:32 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img Apr 14 03:04:32 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:04:33 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Flow 'volume_create_manager' (929623ca-1c1d-4557-9c1f-99379d5f57ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a54b8f-485d-4c78-b5a0-365c7efcb96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img" returned: 1 in 0.498s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img /opt/stack/data/cinder/conversion/vol_upload_zs_rx1ua {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:33 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img /opt/stack/data/cinder/conversion/vol_upload_zs_rx1ua Apr 14 03:04:33 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a54b8f-485d-4c78-b5a0-365c7efcb96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-5466373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4ee4b1-1505-4dfa-b0e0-16d181c0f644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a427cd63eae94baf8b9a976c934a7af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:33Z,use_quota=True,user_id='1abab956234d460c903205766b227b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c0b6bd-c417-49fe-a4e7-ef3435137d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c0b6bd-c417-49fe-a4e7-ef3435137d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf492979-5242-4055-8cf5-4cc573fa971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf492979-5242-4055-8cf5-4cc573fa971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4ee4b1-1505-4dfa-b0e0-16d181c0f644', 'volume_name': 'volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644', 'volume_size': 2}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc9ad28-89c3-4f11-aeb0-07646f59f284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc9ad28-89c3-4f11-aeb0-07646f59f284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbc34cc-aa4a-40b6-a61f-1e7fce9fa8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:33 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Volume 6c4ee4b1-1505-4dfa-b0e0-16d181c0f644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644', 'volume_size': 2} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:33 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img /opt/stack/data/cinder/conversion/vol_upload_zs_rx1ua" returned: 0 in 0.434s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Image conversion details: src /opt/stack/data/cinder/conversion/665d60af-6ec7-491c-af15-17845671ea70.temp_image.6c773677-a3e1-4167-b866-1b7fbffbe883r1xj33bj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zs_rx1ua {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:04:33 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6f46f2-9801-4488-b840-f9b5913e7e61]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zs_rx1ua {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:33 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zs_rx1ua Apr 14 03:04:33 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:34 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zs_rx1ua" returned: 0 in 0.456s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.851s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Uploaded volume to glance image-id: 6c773677-a3e1-4167-b866-1b7fbffbe883. {{(pid=82473) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.736s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Creating offline snapshot bbd3fa6c-d0cf-46cb-b763-7eff64bf810b of volume 897f6298-580e-467f-898e-b530f15fe6d1 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:04:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-56f580ac-ee0a-4ec4-ae7b-070b4bb6b362 tempest-VolumesActionsTest-1322041277 None] Copy volume to image completed successfully. Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544350c-7106-41be-84d1-8657d7595579]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:35 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 Apr 14 03:04:35 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:35 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1" returned: 0 in 0.528s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:35 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b 1G Apr 14 03:04:35 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "cinder-quobyte-665d60af-6ec7-491c-af15-17845671ea70" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-quobyte-665d60af-6ec7-491c-af15-17845671ea70" acquired by "delete_volume" :: waited 0.016s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a3530c-b4d5-4c91-9718-be8c1f141740]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:36 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:04:36 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:36 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b 1G" returned: 0 in 0.539s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897f6298-580e-467f-898e-b530f15fe6d1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:36 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897f6298-580e-467f-898e-b530f15fe6d1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b Apr 14 03:04:36 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:36 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.541s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:36 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70 Apr 14 03:04:36 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:36 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897f6298-580e-467f-898e-b530f15fe6d1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:36 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:04:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:36 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b Apr 14 03:04:36 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:36 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-665d60af-6ec7-491c-af15-17845671ea70" returned: 0 in 0.445s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-quobyte-665d60af-6ec7-491c-af15-17845671ea70" released by "delete_volume" :: held 1.016s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Created reservations ['ba15c76f-1b81-43d9-9157-80cebbd234a3', '78258ecf-d5cb-4880-9c3b-1a34c2b9e2f2', '3cce7360-b43c-4e97-9b01-f5ad17621804', '78a5068c-946a-4328-a9be-73789e683c2a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:37 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b" returned: 0 in 0.426s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:37 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:37 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:37 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.info Apr 14 03:04:37 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:37 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.444s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:37 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Deleted volume successfully. Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a7f1febd-045d-44d7-b1df-6c870414ad05 tempest-VolumesActionsTest-1322041277 None] Lock "cinder-665d60af-6ec7-491c-af15-17845671ea70-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:37 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.info" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:37 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 14 03:04:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:37 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.info Apr 14 03:04:37 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:38 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.info" returned: 0 in 0.460s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.962s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.685s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-5466373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4ee4b1-1505-4dfa-b0e0-16d181c0f644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a427cd63eae94baf8b9a976c934a7af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:33Z,use_quota=True,user_id='1abab956234d460c903205766b227b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Creating volume 6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:04:38 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 2147483648 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:38 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 2147483648 Apr 14 03:04:38 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5d8a2305-6f29-4d48-a646-13cd6d232fa9 tempest-GroupSnapshotsTest-719658903 None] group_snapshot 30d80424-0c02-4ce0-88d8-cbed23455070: created successfully Apr 14 03:04:38 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 2147483648" returned: 0 in 0.563s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:38 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 Apr 14 03:04:38 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] group_snapshot 30d80424-0c02-4ce0-88d8-cbed23455070: deleting Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] group_snapshot 30d80424-0c02-4ce0-88d8-cbed23455070: deleting {{(pid=82473) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-897f6298-580e-467f-898e-b530f15fe6d1" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-897f6298-580e-467f-898e-b530f15fe6d1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-bbd3fa6c-d0cf-46cb-b763-7eff64bf810b" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-bbd3fa6c-d0cf-46cb-b763-7eff64bf810b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Deleting offline snapshot bbd3fa6c-d0cf-46cb-b763-7eff64bf810b of volume 897f6298-580e-467f-898e-b530f15fe6d1 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] snapshot_file for this snap is: volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2479ea1-6de9-4b08-99f7-de1fb7bef929]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:39 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b Apr 14 03:04:39 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:39 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644" returned: 0 in 0.509s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbc34cc-aa4a-40b6-a61f-1e7fce9fa8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644', 'volume_size': 2}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643d86c6-21f4-45cf-bcdd-b0eaa52c3b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:39 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Volume volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 (6c4ee4b1-1505-4dfa-b0e0-16d181c0f644): created successfully Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643d86c6-21f4-45cf-bcdd-b0eaa52c3b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Flow 'volume_create_manager' (929623ca-1c1d-4557-9c1f-99379d5f57ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:39 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-68fa9e38-8cb9-4581-a1b2-f48e1dc2c318 tempest-VolumesCloneNegativeTest-1891135858 None] Created volume successfully. Apr 14 03:04:39 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b" returned: 0 in 0.573s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-897f6298-580e-467f-898e-b530f15fe6d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[7357ec1e-60aa-4a3b-9a5d-14edfee2495a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:39 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 Apr 14 03:04:39 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Acquiring lock "cinder-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "cinder-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Acquiring lock "cinder-quobyte-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "cinder-quobyte-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebce32b-246e-4268-bedd-807c96b2f8bc]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:39 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 Apr 14 03:04:39 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:40 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1" returned: 0 in 0.593s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:40 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b Apr 14 03:04:40 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:40 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644" returned: 0 in 0.564s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:40 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644 Apr 14 03:04:40 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:40 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b" returned: 0 in 0.617s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:40 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b Apr 14 03:04:40 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:40 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644" returned: 0 in 0.542s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "cinder-quobyte-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644" released by "delete_volume" :: held 1.133s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:40 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Created reservations ['2efb3557-9601-48da-bd79-24ba6ecec974', '82344fc6-bf91-4e4f-9bab-dbe34bd4c1cb', 'fe3030fe-40a5-4df3-b179-99d5654b97aa', '30d6c618-fcb3-40ae-9953-c61e6c385c8a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:41 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:41 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:41 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1.bbd3fa6c-d0cf-46cb-b763-7eff64bf810b" returned: 0 in 0.477s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-bbd3fa6c-d0cf-46cb-b763-7eff64bf810b" released by "_delete_snapshot" :: held 2.344s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-897f6298-580e-467f-898e-b530f15fe6d1" released by "delete_snapshot" :: held 2.355s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:41 devstack cinder-volume[82473]: WARNING cinder.quota [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1991446603 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1991446603, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:04:41 devstack cinder-volume[82473]: WARNING cinder.quota [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1991446603 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1991446603, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] Created reservations ['95473fec-1e1f-47d4-b0ee-b56e09a3e9c6', 'de385ae3-bb3c-456a-bf5f-cc40cab1e156', '22d70f5d-0294-4f20-9bfe-7bd93fde4efb', '241c6a2a-0e5d-43de-b555-c18cc5b0d581'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:41 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d7373329-7e4c-43c0-8385-31f55e63cc99 tempest-GroupSnapshotsTest-719658903 None] group_snapshot 30d80424-0c02-4ce0-88d8-cbed23455070: deleted successfully Apr 14 03:04:41 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.470s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:41 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Deleted volume successfully. Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3d92ba84-e523-4f5a-ab1d-4501c81886b4 tempest-VolumesCloneNegativeTest-1891135858 None] Lock "cinder-6c4ee4b1-1505-4dfa-b0e0-16d181c0f644-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Flow 'volume_create_manager' (ca1ddc69-64dd-4e59-b33b-d732852eda44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95e4821-7c46-49ea-a500-ea5623fe4f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95e4821-7c46-49ea-a500-ea5623fe4f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-21638947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50227d79-fce0-416d-a7f2-30ed1d3621d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3245172be8d44c1dbf019439709eefce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:42Z,use_quota=True,user_id='a01ee141c6374b6498eb6a5eac6d4a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf43a73-8eba-471d-9f30-86c19b8267d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf43a73-8eba-471d-9f30-86c19b8267d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839e68fe-dcb2-4e6b-a6af-5a1b08600005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839e68fe-dcb2-4e6b-a6af-5a1b08600005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50227d79-fce0-416d-a7f2-30ed1d3621d1', 'volume_name': 'volume-50227d79-fce0-416d-a7f2-30ed1d3621d1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:41 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0fbb37b-b99c-447d-b1ec-3bbe45f2befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0fbb37b-b99c-447d-b1ec-3bbe45f2befe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce160ea-e704-4e8c-a1be-b17e716e5888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:42 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Volume 50227d79-fce0-416d-a7f2-30ed1d3621d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50227d79-fce0-416d-a7f2-30ed1d3621d1', 'volume_size': 1} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-21638947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50227d79-fce0-416d-a7f2-30ed1d3621d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3245172be8d44c1dbf019439709eefce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:42Z,use_quota=True,user_id='a01ee141c6374b6498eb6a5eac6d4a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Creating volume 50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:04:42 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:42 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 1073741824 Apr 14 03:04:42 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "cinder-quobyte-897f6298-580e-467f-898e-b530f15fe6d1" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-897f6298-580e-467f-898e-b530f15fe6d1" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d050d7-da08-4182-bfb5-ef9093751432]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:42 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 Apr 14 03:04:42 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:42 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 1073741824" returned: 0 in 0.567s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:42 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 Apr 14 03:04:42 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:42 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1" returned: 0 in 0.581s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:42 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1 Apr 14 03:04:42 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:43 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1" returned: 0 in 0.472s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce160ea-e704-4e8c-a1be-b17e716e5888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50227d79-fce0-416d-a7f2-30ed1d3621d1', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd350bc-ed57-4430-b02c-6be6809e6976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:43 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Volume volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 (50227d79-fce0-416d-a7f2-30ed1d3621d1): created successfully Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd350bc-ed57-4430-b02c-6be6809e6976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Flow 'volume_create_manager' (ca1ddc69-64dd-4e59-b33b-d732852eda44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:43 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-580b609d-ac78-4dac-84b5-e09662f1972d tempest-VolumesCloneTest-1980489558 None] Created volume successfully. Apr 14 03:04:43 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-897f6298-580e-467f-898e-b530f15fe6d1" returned: 0 in 0.466s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Lock "cinder-quobyte-897f6298-580e-467f-898e-b530f15fe6d1" released by "delete_volume" :: held 1.084s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Created reservations ['e12d9ff4-de88-4deb-8969-7c8382bea27d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:43 devstack cinder-volume[82473]: WARNING cinder.quota [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1991446603 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1991446603, it is now deprecated. Please use the default quota class for default quota. Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Created reservations ['77e78efe-ef73-4a43-afb5-a70d7f6ca690', 'a7ca6402-2104-4846-b3d9-15bab4bc3048', '64947d30-4fd6-4c0b-a0fb-53ea91d96a1c', '2701b62c-bfbf-46c8-9859-d1362be2a667'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:43 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:43 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Flow 'volume_create_manager' (0e910fd8-a851-4525-bdc3-76d733ea9fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633c4cbf-454d-4252-8028-7107b6f00490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633c4cbf-454d-4252-8028-7107b6f00490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-548062030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333c9895-60ec-4118-b603-b9b2dd9cfbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abeb5e5dd0e421fb66fc685ccbef0af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:44Z,use_quota=True,user_id='561cd034075a453ea8c170c8537e7617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380438df-3d2c-42dd-91f2-67a64fb13854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380438df-3d2c-42dd-91f2-67a64fb13854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4393bfda-5a32-4fda-be38-0045e9003537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4393bfda-5a32-4fda-be38-0045e9003537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333c9895-60ec-4118-b603-b9b2dd9cfbce', 'volume_name': 'volume-333c9895-60ec-4118-b603-b9b2dd9cfbce', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d2e03f-522e-432d-afa9-e8a28fb27ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d2e03f-522e-432d-afa9-e8a28fb27ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e1670a-e275-4a9f-8877-2ec3789704c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:43 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Volume 333c9895-60ec-4118-b603-b9b2dd9cfbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333c9895-60ec-4118-b603-b9b2dd9cfbce', 'volume_size': 1} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-548062030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333c9895-60ec-4118-b603-b9b2dd9cfbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7abeb5e5dd0e421fb66fc685ccbef0af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:44Z,use_quota=True,user_id='561cd034075a453ea8c170c8537e7617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Creating volume 333c9895-60ec-4118-b603-b9b2dd9cfbce {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:04:43 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:43 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce 1073741824 Apr 14 03:04:43 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:43 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.440s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:43 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:43 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-633d5102-7802-441c-b6c0-7c77a686dc07 tempest-GroupSnapshotsTest-719658903 None] Delete group completed successfully. Apr 14 03:04:44 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce 1073741824" returned: 0 in 0.517s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:44 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce Apr 14 03:04:44 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Flow 'volume_create_manager' (52999e48-15d0-4b71-b804-b5e951292065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c745051-a028-4b4f-b1f1-c981154c8005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c745051-a028-4b4f-b1f1-c981154c8005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-314840523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36130d70-0cf9-4aa4-9dd0-3536ed10ff10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3245172be8d44c1dbf019439709eefce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=50227d79-fce0-416d-a7f2-30ed1d3621d1,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:44Z,use_quota=True,user_id='a01ee141c6374b6498eb6a5eac6d4a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18db2459-b146-4462-b9fb-f1cc3f3176cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18db2459-b146-4462-b9fb-f1cc3f3176cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3487eed2-d877-4bae-884a-4d7fabd118a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3487eed2-d877-4bae-884a-4d7fabd118a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '36130d70-0cf9-4aa4-9dd0-3536ed10ff10', 'volume_name': 'volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10', 'volume_size': 2, 'source_volid': '50227d79-fce0-416d-a7f2-30ed1d3621d1', 'source_volstatus': 'available'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7e6785-ef1a-4da2-88b4-af032220f1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7e6785-ef1a-4da2-88b4-af032220f1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca09f5f5-bf5d-4099-8c00-b117b98f3fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:44 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Volume 36130d70-0cf9-4aa4-9dd0-3536ed10ff10: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10', 'volume_size': 2, 'source_volid': '50227d79-fce0-416d-a7f2-30ed1d3621d1', 'source_volstatus': 'available'} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:44 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.341s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:44 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Cloning volume 50227d79-fce0-416d-a7f2-30ed1d3621d1 to volume 36130d70-0cf9-4aa4-9dd0-3536ed10ff10 Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e1670a-e275-4a9f-8877-2ec3789704c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333c9895-60ec-4118-b603-b9b2dd9cfbce', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de76ff24-7dd1-46a1-9de1-0853e3e311cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:44 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Volume volume-333c9895-60ec-4118-b603-b9b2dd9cfbce (333c9895-60ec-4118-b603-b9b2dd9cfbce): created successfully Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de76ff24-7dd1-46a1-9de1-0853e3e311cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Flow 'volume_create_manager' (0e910fd8-a851-4525-bdc3-76d733ea9fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Creating offline snapshot bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e of volume 50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:04:44 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-0df9a05b-7bef-4b71-a060-1bc94b4f740e tempest-VolumesNegativeTest-1931908001 None] Created volume successfully. Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acb15ab-2f1b-42f9-863e-1b1f09086588]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:44 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 Apr 14 03:04:44 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:45 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1" returned: 0 in 0.530s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:45 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e 1G Apr 14 03:04:45 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:45 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e 1G" returned: 0 in 0.598s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:45 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e Apr 14 03:04:45 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:46 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" returned: 0 in 0.598s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:46 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e is being set with open permissions: ugo+rw Apr 14 03:04:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:46 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e Apr 14 03:04:46 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:47 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:47 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.info Apr 14 03:04:47 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:47 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.info" returned: 0 in 0.496s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:47 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.info is being set with open permissions: ugo+rw Apr 14 03:04:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:47 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.info Apr 14 03:04:47 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:47 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.info" returned: 0 in 0.466s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:47 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Acquiring lock "cinder-quobyte-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Lock "cinder-quobyte-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] snapshot: bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e, volume: 36130d70-0cf9-4aa4-9dd0-3536ed10ff10, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[50119c31-e8d5-4d7b-98f6-12fc31f80dbe]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:48 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e Apr 14 03:04:48 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:48 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" returned: 0 in 0.570s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50227d79-fce0-416d-a7f2-30ed1d3621d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[840de02d-550a-4dba-af6d-c62cd7d4efcd]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:48 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 Apr 14 03:04:48 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:49 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1" returned: 0 in 0.554s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:49 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:04:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:49 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 Apr 14 03:04:49 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:51 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" returned: 0 in 2.337s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:51 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0221ae20-1de5-4080-928e-e7b6d9ba4ec9]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:51 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 Apr 14 03:04:51 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:52 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1" returned: 0 in 0.808s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:04:52 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Converted 1024.00 MB image at 437.90 MB/s Apr 14 03:04:52 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 is being set with open permissions: ugo+rw Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:52 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 Apr 14 03:04:52 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:52 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" returned: 0 in 0.578s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Lock "cinder-quobyte-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" released by "_copy_volume_from_snapshot" :: held 4.904s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Acquiring lock "cinder-quobyte-bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Lock "cinder-quobyte-bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Deleting offline snapshot bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e of volume 50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] snapshot_file for this snap is: volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e7e6c-0561-4be9-8e23-d80be7f23e82]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:53 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e Apr 14 03:04:53 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:53 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" returned: 0 in 0.602s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50227d79-fce0-416d-a7f2-30ed1d3621d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:04:53 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[b601d911-5a83-43e4-ace5-4a6c62874426]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:53 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 Apr 14 03:04:53 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:54 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1" returned: 0 in 0.583s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:54 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e Apr 14 03:04:54 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:54 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" returned: 0 in 0.535s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:54 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e Apr 14 03:04:54 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:55 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1.bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" returned: 0 in 0.482s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Lock "cinder-quobyte-bc9b935a-ce89-4bf0-8e45-1d65fdf4ce7e" released by "_delete_snapshot" :: held 2.281s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.514s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca09f5f5-bf5d-4099-8c00-b117b98f3fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10', 'volume_size': 2, 'source_volid': '50227d79-fce0-416d-a7f2-30ed1d3621d1', 'source_volstatus': 'available'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30582795-ffc1-4a73-a29a-127ced0a2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:55 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Volume volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 (36130d70-0cf9-4aa4-9dd0-3536ed10ff10): created successfully Apr 14 03:04:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30582795-ffc1-4a73-a29a-127ced0a2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Flow 'volume_create_manager' (52999e48-15d0-4b71-b804-b5e951292065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:55 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ccbf3ef7-3677-4e23-994e-d1ad0043cd4f tempest-VolumesCloneTest-1980489558 None] Created volume successfully. Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Acquiring lock "cinder-36130d70-0cf9-4aa4-9dd0-3536ed10ff10-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Lock "cinder-36130d70-0cf9-4aa4-9dd0-3536ed10ff10-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Acquiring lock "cinder-quobyte-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Lock "cinder-quobyte-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6c1f43-3018-4e90-a6ff-51782991c6e2]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:56 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 Apr 14 03:04:56 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Flow 'volume_create_manager' (9099f399-0487-41b0-8852-241cd86ba0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7a9350-fc12-490d-8b6a-9dd94335a6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7a9350-fc12-490d-8b6a-9dd94335a6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1539872282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a9a669-727c-48f1-81fb-75574c90a11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa7582eb2a4fa9b6f3de8ecf9f0e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:56Z,use_quota=True,user_id='7defcbab81f340f085ea329f8bfbcf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498be3ca-5a46-48e0-b29f-0f66e1c17004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498be3ca-5a46-48e0-b29f-0f66e1c17004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af72ac6-00c9-4937-b66c-23359197da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af72ac6-00c9-4937-b66c-23359197da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a9a669-727c-48f1-81fb-75574c90a11a', 'volume_name': 'volume-d0a9a669-727c-48f1-81fb-75574c90a11a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b49fa1f-047d-419f-b0c6-ee7f0f92134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b49fa1f-047d-419f-b0c6-ee7f0f92134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaafcf8-3056-4ae3-8c1f-95e8ebc2cc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:56 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Volume d0a9a669-727c-48f1-81fb-75574c90a11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a9a669-727c-48f1-81fb-75574c90a11a', 'volume_size': 1} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1539872282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a9a669-727c-48f1-81fb-75574c90a11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa7582eb2a4fa9b6f3de8ecf9f0e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:04:56Z,use_quota=True,user_id='7defcbab81f340f085ea329f8bfbcf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Creating volume d0a9a669-727c-48f1-81fb-75574c90a11a {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:04:56 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:56 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a 1073741824 Apr 14 03:04:56 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:56 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" returned: 0 in 0.522s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:56 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10 Apr 14 03:04:56 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:56 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a 1073741824" returned: 0 in 0.513s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:57 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a Apr 14 03:04:57 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:57 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" returned: 0 in 0.468s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Lock "cinder-quobyte-36130d70-0cf9-4aa4-9dd0-3536ed10ff10" released by "delete_volume" :: held 1.016s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Created reservations ['bd88585f-bbe4-42aa-9e40-27fd0141531d', '7f45829e-71b6-4fea-abea-3134c12f2f9e', 'cf205829-44ac-4867-ab07-67b243d5c57e', '2aaf906f-1589-4f88-89f8-2a36063adfc6'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:57 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:57 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:57 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaafcf8-3056-4ae3-8c1f-95e8ebc2cc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a9a669-727c-48f1-81fb-75574c90a11a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0bfb9a3-5a0b-4a9e-8acb-0412c55d5680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:04:57 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Volume volume-d0a9a669-727c-48f1-81fb-75574c90a11a (d0a9a669-727c-48f1-81fb-75574c90a11a): created successfully Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0bfb9a3-5a0b-4a9e-8acb-0412c55d5680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Flow 'volume_create_manager' (9099f399-0487-41b0-8852-241cd86ba0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:04:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7d494fcf-e060-4bbe-92d7-a0b5720aef7b tempest-VolumeQuotasAdminTestJSON-27917574 None] Created volume successfully. Apr 14 03:04:57 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.546s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:04:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Deleted volume successfully. Apr 14 03:04:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0875c9b5-b079-4ab7-938d-3289f8adbfcd tempest-VolumesCloneTest-1980489558 None] Lock "cinder-36130d70-0cf9-4aa4-9dd0-3536ed10ff10-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Acquiring lock "cinder-50227d79-fce0-416d-a7f2-30ed1d3621d1-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Lock "cinder-50227d79-fce0-416d-a7f2-30ed1d3621d1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Acquiring lock "cinder-quobyte-50227d79-fce0-416d-a7f2-30ed1d3621d1" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Lock "cinder-quobyte-50227d79-fce0-416d-a7f2-30ed1d3621d1" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0497a0bc-4431-4783-8b8b-84bf89123c3c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Acquiring lock "cinder-d0a9a669-727c-48f1-81fb-75574c90a11a-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "cinder-d0a9a669-727c-48f1-81fb-75574c90a11a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:58 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 Apr 14 03:04:58 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Acquiring lock "cinder-quobyte-d0a9a669-727c-48f1-81fb-75574c90a11a" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "cinder-quobyte-d0a9a669-727c-48f1-81fb-75574c90a11a" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0d3686-27ff-4510-940b-08c2acff0c45]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:04:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:58 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a Apr 14 03:04:58 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:59 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1" returned: 0 in 0.499s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:59 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1 Apr 14 03:04:59 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:59 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:59 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a Apr 14 03:04:59 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:59 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-50227d79-fce0-416d-a7f2-30ed1d3621d1" returned: 0 in 0.596s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Lock "cinder-quobyte-50227d79-fce0-416d-a7f2-30ed1d3621d1" released by "delete_volume" :: held 1.146s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:59 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-d0a9a669-727c-48f1-81fb-75574c90a11a" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "cinder-quobyte-d0a9a669-727c-48f1-81fb-75574c90a11a" released by "delete_volume" :: held 1.051s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Created reservations ['bb53f945-3889-4e74-ac32-82483681c7ac', '4f8e0e42-df68-42b5-9465-e87fd72418fa', 'f074b961-9fd6-4e1f-bfe0-62b2bc39acc0', 'b622a257-ea4e-44b2-a1fa-dd096ed44911'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Created reservations ['08c340d7-8358-447a-88cf-7584cc1699b9', '7a1eaafc-7b84-4831-a243-04dc7899b09f', '25911252-df30-4e91-aa49-f6c3fce00e87', 'a3c1c6ef-46c1-4c81-aecf-c141ee1fe385'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:59 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:59 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:04:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:04:59 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:04:59 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:00 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.451s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:00 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:00 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Deleted volume successfully. Apr 14 03:05:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ac022b80-0d03-4135-b848-f5d79c9a27d0 tempest-VolumesCloneTest-1980489558 None] Lock "cinder-50227d79-fce0-416d-a7f2-30ed1d3621d1-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:00 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.547s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:00 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:00 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Deleted volume successfully. Apr 14 03:05:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ce96ff25-2c2d-4f74-9e85-83a9faa42b78 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "cinder-d0a9a669-727c-48f1-81fb-75574c90a11a-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Flow 'volume_create_manager' (16c23db3-1851-4b64-b31e-8d620bf8f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b243f9de-f169-4fec-8482-0d1d778a395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b243f9de-f169-4fec-8482-0d1d778a395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1689467657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda66d34-5afa-4254-ac44-0c9a9625ef2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa7582eb2a4fa9b6f3de8ecf9f0e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:01Z,use_quota=True,user_id='7defcbab81f340f085ea329f8bfbcf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc55c3c-164d-4ee0-a06f-0708412efeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc55c3c-164d-4ee0-a06f-0708412efeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018a6fa2-ac18-44b5-bdff-b77963c87f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018a6fa2-ac18-44b5-bdff-b77963c87f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda66d34-5afa-4254-ac44-0c9a9625ef2a', 'volume_name': 'volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a33e82-9f05-4e3e-baf8-b24e79175c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a33e82-9f05-4e3e-baf8-b24e79175c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed4926e-d782-406a-819d-2988a917ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:01 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Volume fda66d34-5afa-4254-ac44-0c9a9625ef2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a', 'volume_size': 1} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1689467657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda66d34-5afa-4254-ac44-0c9a9625ef2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fa7582eb2a4fa9b6f3de8ecf9f0e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:01Z,use_quota=True,user_id='7defcbab81f340f085ea329f8bfbcf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Creating volume fda66d34-5afa-4254-ac44-0c9a9625ef2a {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:01 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:01 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a 1073741824 Apr 14 03:05:01 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:01 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a 1073741824" returned: 0 in 0.649s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:01 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a Apr 14 03:05:01 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:02 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a" returned: 0 in 0.439s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed4926e-d782-406a-819d-2988a917ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e687ce-7f08-44f9-b43b-a0f213b7840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:02 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Volume volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a (fda66d34-5afa-4254-ac44-0c9a9625ef2a): created successfully Apr 14 03:05:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e687ce-7f08-44f9-b43b-a0f213b7840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Flow 'volume_create_manager' (16c23db3-1851-4b64-b31e-8d620bf8f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:02 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ddf8c940-f74e-43f4-b720-3d4b96c97449 tempest-VolumeQuotasAdminTestJSON-27917574 None] Created volume successfully. Apr 14 03:05:03 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f6e2e00e-ec67-4312-a024-cc70afa724d2 tempest-VolumeQuotasAdminTestJSON-243276489 None] Transfer volume completed successfully. Apr 14 03:05:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Acquiring lock "cinder-fda66d34-5afa-4254-ac44-0c9a9625ef2a-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Lock "cinder-fda66d34-5afa-4254-ac44-0c9a9625ef2a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Acquiring lock "cinder-quobyte-fda66d34-5afa-4254-ac44-0c9a9625ef2a" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Lock "cinder-quobyte-fda66d34-5afa-4254-ac44-0c9a9625ef2a" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:04 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e80c6a2-b97a-447f-aaf4-b279c63da725]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:04 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a Apr 14 03:05:04 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:05 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a" returned: 0 in 0.554s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:05 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a Apr 14 03:05:05 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:05 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fda66d34-5afa-4254-ac44-0c9a9625ef2a" returned: 0 in 0.443s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Lock "cinder-quobyte-fda66d34-5afa-4254-ac44-0c9a9625ef2a" released by "delete_volume" :: held 1.033s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Created reservations ['78a67aca-40a5-40fe-b912-a4ace775add1', '29fe8b72-7d47-4187-87f3-8a4a22cc3364', 'a6cfc88c-c25e-43c4-a2b6-af691dd2c34b', 'ffd4a9ff-4a38-44db-9b7a-d6bf23ef9764'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:05 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:05 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:06 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.472s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:06 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:06 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Deleted volume successfully. Apr 14 03:05:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-45784c19-0a05-4373-8d52-0992aad5ce07 tempest-VolumeQuotasAdminTestJSON-12588374 None] Lock "cinder-fda66d34-5afa-4254-ac44-0c9a9625ef2a-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (b9944323-40ea-4ab9-a157-249be8d1e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4491c3a-4084-4960-b0ba-69c2a7fc17ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4491c3a-4084-4960-b0ba-69c2a7fc17ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-461454819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06180b74-9d57-44f0-baba-63cc195c1fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27eee834dc174e30aa171f3e00c0d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:10Z,use_quota=True,user_id='135c94fc4f8a49b38ecf16c62bfc6ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b116d6ce-a6e8-49ba-82b7-15d1354c89c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b116d6ce-a6e8-49ba-82b7-15d1354c89c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef01699-3ce2-45a1-b700-ab393194c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef01699-3ce2-45a1-b700-ab393194c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06180b74-9d57-44f0-baba-63cc195c1fe9', 'volume_name': 'volume-06180b74-9d57-44f0-baba-63cc195c1fe9', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2901e144-9fb1-48e8-ba4b-5d0f3d0e00f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2901e144-9fb1-48e8-ba4b-5d0f3d0e00f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d01e9f-f0ff-48a3-99d6-658d22d110e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:09 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Volume 06180b74-9d57-44f0-baba-63cc195c1fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06180b74-9d57-44f0-baba-63cc195c1fe9', 'volume_size': 1} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-461454819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06180b74-9d57-44f0-baba-63cc195c1fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27eee834dc174e30aa171f3e00c0d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:10Z,use_quota=True,user_id='135c94fc4f8a49b38ecf16c62bfc6ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Creating volume 06180b74-9d57-44f0-baba-63cc195c1fe9 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:09 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:09 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 1073741824 Apr 14 03:05:09 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:10 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 1073741824" returned: 0 in 0.652s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Acquiring lock "cinder-333c9895-60ec-4118-b603-b9b2dd9cfbce-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:10 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 Apr 14 03:05:10 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Lock "cinder-333c9895-60ec-4118-b603-b9b2dd9cfbce-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Acquiring lock "cinder-quobyte-333c9895-60ec-4118-b603-b9b2dd9cfbce" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Lock "cinder-quobyte-333c9895-60ec-4118-b603-b9b2dd9cfbce" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[924033af-9cb1-49da-92b4-af4ac229e80f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:10 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce Apr 14 03:05:10 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:10 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9" returned: 0 in 0.476s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d01e9f-f0ff-48a3-99d6-658d22d110e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06180b74-9d57-44f0-baba-63cc195c1fe9', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9182cbdc-74e9-49cd-af4a-452494169fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:11 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Volume volume-06180b74-9d57-44f0-baba-63cc195c1fe9 (06180b74-9d57-44f0-baba-63cc195c1fe9): created successfully Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9182cbdc-74e9-49cd-af4a-452494169fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (b9944323-40ea-4ab9-a157-249be8d1e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:11 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-042772d6-26db-4336-b660-ae138cf691c0 tempest-VolumesSnapshotTestJSON-188249116 None] Created volume successfully. Apr 14 03:05:11 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce" returned: 0 in 0.523s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:11 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce Apr 14 03:05:11 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:11 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-333c9895-60ec-4118-b603-b9b2dd9cfbce" returned: 0 in 0.475s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Lock "cinder-quobyte-333c9895-60ec-4118-b603-b9b2dd9cfbce" released by "delete_volume" :: held 1.032s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Created reservations ['7956bc4c-83e1-4f64-94d2-a4925305d352', '14a2d6e1-5c72-4c43-841b-f208e62641dd', 'd4b3f568-7b81-48a4-88b5-4ebed6cd49bb', 'ca0d2ba9-c67d-4bf7-8b39-e51ca7f4d957'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:11 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:11 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Creating offline snapshot 00ae6893-9e18-42c8-bf7d-607a758dac16 of volume 06180b74-9d57-44f0-baba-63cc195c1fe9 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f8012-e07c-4208-acfb-e70423e492ec]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:12 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.491s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:12 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Deleted volume successfully. Apr 14 03:05:12 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 Apr 14 03:05:12 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a962ef3-24b7-4d8d-bec8-fa62747eea40 tempest-VolumesNegativeTest-1931908001 None] Lock "cinder-333c9895-60ec-4118-b603-b9b2dd9cfbce-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:12 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9" returned: 0 in 0.544s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:12 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 1G Apr 14 03:05:12 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:13 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 1G" returned: 0 in 0.605s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06180b74-9d57-44f0-baba-63cc195c1fe9 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:13 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06180b74-9d57-44f0-baba-63cc195c1fe9 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 Apr 14 03:05:13 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:13 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06180b74-9d57-44f0-baba-63cc195c1fe9 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16" returned: 0 in 0.577s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:13 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 is being set with open permissions: ugo+rw Apr 14 03:05:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:13 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 Apr 14 03:05:13 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Flow 'volume_create_manager' (46520f93-7812-48b6-b057-ca778d967129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9403c468-177d-4abc-8bad-654d26df79fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9403c468-177d-4abc-8bad-654d26df79fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1681082312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8859a5-fb69-4cf0-a774-9fe2187a42d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bd1defdf9b4df69660307bb2b80a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:14Z,use_quota=True,user_id='dd825c1bfa44440bbb7ae105a726fed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99544301-c71a-4c84-9ad5-d321e90dcf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99544301-c71a-4c84-9ad5-d321e90dcf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2efc2d-75fa-4bd5-86b2-593fa27a48f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2efc2d-75fa-4bd5-86b2-593fa27a48f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8859a5-fb69-4cf0-a774-9fe2187a42d8', 'volume_name': 'volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd675be-cc4b-41e0-97da-ed75d7c7d822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd675be-cc4b-41e0-97da-ed75d7c7d822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffde2995-c39c-4978-aa99-cf02967411a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Volume ba8859a5-fb69-4cf0-a774-9fe2187a42d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8', 'volume_size': 1} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:14 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Flow 'volume_create_manager' (7af1093f-e883-450c-bbe2-e4999c7acd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5cad1a-d460-4a68-b297-09aa3ce58c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16" returned: 0 in 0.531s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5cad1a-d460-4a68-b297-09aa3ce58c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-901156962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735a8f18-337e-4816-9868-224ef6946e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f94b4aeb0f84769943fc46a70b804d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:14Z,use_quota=True,user_id='0fde3c81914446ef902a2c395cdc5ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b00a522-0b05-49ac-af78-83f3ac975d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b00a522-0b05-49ac-af78-83f3ac975d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78670e67-d7f5-494b-90a8-f0ad0cbf05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78670e67-d7f5-494b-90a8-f0ad0cbf05b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735a8f18-337e-4816-9868-224ef6946e1d', 'volume_name': 'volume-735a8f18-337e-4816-9868-224ef6946e1d', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6afe88c-2dbc-4746-8110-74c352456c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6afe88c-2dbc-4746-8110-74c352456c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077e43ac-1594-4b00-ae33-8e8e5a305878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:14 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Volume 735a8f18-337e-4816-9868-224ef6946e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735a8f18-337e-4816-9868-224ef6946e1d', 'volume_size': 1} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:14 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.info Apr 14 03:05:14 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:14 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:14 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:14 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.info" returned: 0 in 0.419s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:14 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.info is being set with open permissions: ugo+rw Apr 14 03:05:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:14 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.info Apr 14 03:05:14 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:15 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.424s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:15 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.info" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.205s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1681082312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8859a5-fb69-4cf0-a774-9fe2187a42d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16bd1defdf9b4df69660307bb2b80a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:14Z,use_quota=True,user_id='dd825c1bfa44440bbb7ae105a726fed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Creating volume ba8859a5-fb69-4cf0-a774-9fe2187a42d8 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:15 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:15 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 1073741824 Apr 14 03:05:15 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=125,cinder:UPDATE=145,cinder:INSERT=44,cinder:DELETE=7 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:05:15 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e51e07f8-a048-431c-b378-5d17da47cac7 tempest-VolumesSnapshotTestJSON-188249116 None] Create snapshot completed successfully Apr 14 03:05:15 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 1073741824" returned: 0 in 0.499s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:15 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 Apr 14 03:05:15 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:16 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" returned: 0 in 0.412s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-901156962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735a8f18-337e-4816-9868-224ef6946e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f94b4aeb0f84769943fc46a70b804d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:14Z,use_quota=True,user_id='0fde3c81914446ef902a2c395cdc5ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Creating volume 735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:16 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffde2995-c39c-4978-aa99-cf02967411a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:16 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d 1073741824 Apr 14 03:05:16 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44d5401-d8e3-4e24-bd34-7e8fc21da9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:16 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Volume volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 (ba8859a5-fb69-4cf0-a774-9fe2187a42d8): created successfully Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44d5401-d8e3-4e24-bd34-7e8fc21da9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Flow 'volume_create_manager' (46520f93-7812-48b6-b057-ca778d967129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:16 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6d22e751-e4ba-4d81-a1b5-0df6deb53604 tempest-SnapshotMetadataTestJSON-158796200 None] Created volume successfully. Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-00ae6893-9e18-42c8-bf7d-607a758dac16-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-00ae6893-9e18-42c8-bf7d-607a758dac16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-06180b74-9d57-44f0-baba-63cc195c1fe9" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-06180b74-9d57-44f0-baba-63cc195c1fe9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-00ae6893-9e18-42c8-bf7d-607a758dac16" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-00ae6893-9e18-42c8-bf7d-607a758dac16" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Deleting offline snapshot 00ae6893-9e18-42c8-bf7d-607a758dac16 of volume 06180b74-9d57-44f0-baba-63cc195c1fe9 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] snapshot_file for this snap is: volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b1b9b1-245f-486b-9b7e-7ef031359903]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:16 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 Apr 14 03:05:16 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:16 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d 1073741824" returned: 0 in 0.565s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:16 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d Apr 14 03:05:16 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:16 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16" returned: 0 in 0.497s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06180b74-9d57-44f0-baba-63cc195c1fe9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa748850-bbe5-4e35-a6da-2a8d7c7cb4a4]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:17 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 Apr 14 03:05:17 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:17 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d" returned: 0 in 0.446s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.777s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (077e43ac-1594-4b00-ae33-8e8e5a305878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735a8f18-337e-4816-9868-224ef6946e1d', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7918993d-94f4-4ed3-b106-d0791c3648ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Creating offline snapshot 591c044a-9b40-43df-8350-09b6396e3915 of volume ba8859a5-fb69-4cf0-a774-9fe2187a42d8 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:17 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Volume volume-735a8f18-337e-4816-9868-224ef6946e1d (735a8f18-337e-4816-9868-224ef6946e1d): created successfully Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7918993d-94f4-4ed3-b106-d0791c3648ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Flow 'volume_create_manager' (7af1093f-e883-450c-bbe2-e4999c7acd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[814e251e-3a54-4e93-a358-9111a5b72754]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:17 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7edd11ca-20b0-4d2f-af53-713bc512e238 tempest-VolumesSnapshotListTestJSON-1693618518 None] Created volume successfully. Apr 14 03:05:17 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 Apr 14 03:05:17 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:17 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9" returned: 0 in 0.468s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:17 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 Apr 14 03:05:17 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:17 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" returned: 0 in 0.534s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:17 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 1G Apr 14 03:05:17 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:17 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16" returned: 0 in 0.534s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:17 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16 Apr 14 03:05:17 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:18 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 1G" returned: 0 in 0.561s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:18 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9.00ae6893-9e18-42c8-bf7d-607a758dac16" returned: 0 in 0.443s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:18 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 Apr 14 03:05:18 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-00ae6893-9e18-42c8-bf7d-607a758dac16" released by "_delete_snapshot" :: held 2.015s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-06180b74-9d57-44f0-baba-63cc195c1fe9" released by "delete_snapshot" :: held 2.028s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Created reservations ['18e7ea19-963d-4c73-88df-04b6734d3e69', '1c06f894-2623-4874-98f4-d357c166b31a', '4b811062-2562-4cd7-8a9a-676ea73a787f', '4890aa13-68c1-4c25-8dba-6aed899bd569'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:18 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Delete snapshot completed successfully. Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-67cd09fa-a97f-46f4-8360-d8f4ece2b46a tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-00ae6893-9e18-42c8-bf7d-607a758dac16-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:18 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915" returned: 0 in 0.463s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:18 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 is being set with open permissions: ugo+rw Apr 14 03:05:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:18 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 Apr 14 03:05:18 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:19 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915" returned: 0 in 0.408s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=128,cinder:INSERT=31,cinder:UPDATE=159,cinder:DELETE=10 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:19 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.info Apr 14 03:05:19 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:19 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.info" returned: 0 in 0.414s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:19 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.info is being set with open permissions: ugo+rw Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:19 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.info Apr 14 03:05:19 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (b7724a88-12f4-4d1c-8ab5-f882133ae269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c50bb6c-470f-4e65-ae3c-66904fa3cbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c50bb6c-470f-4e65-ae3c-66904fa3cbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-41777321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da4cc4f-3181-4127-a817-03a69666feb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27eee834dc174e30aa171f3e00c0d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:20Z,use_quota=True,user_id='135c94fc4f8a49b38ecf16c62bfc6ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32316de0-f299-4da9-a601-a3c22adf8920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32316de0-f299-4da9-a601-a3c22adf8920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9093681f-3003-4a49-9870-6a8e09a92d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9093681f-3003-4a49-9870-6a8e09a92d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da4cc4f-3181-4127-a817-03a69666feb0', 'volume_name': 'volume-6da4cc4f-3181-4127-a817-03a69666feb0', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef98c25-a849-4872-88f9-39b2b7f8549d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef98c25-a849-4872-88f9-39b2b7f8549d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de63271-b800-4d0a-874c-b6a99ca169d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:19 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Volume 6da4cc4f-3181-4127-a817-03a69666feb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da4cc4f-3181-4127-a817-03a69666feb0', 'volume_size': 1} Apr 14 03:05:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:20 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.info" returned: 0 in 0.409s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.863s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.469s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Creating offline snapshot 4c8e719c-5798-4de0-87b1-afb08346fbff of volume 735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:20 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9824012a-4702-4217-bdb0-a75baaaf80e0 tempest-SnapshotMetadataTestJSON-158796200 None] Create snapshot completed successfully Apr 14 03:05:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f469f56d-c546-454b-8d25-ea9c44471662]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:20 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d Apr 14 03:05:20 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:20 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d" returned: 0 in 0.492s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:20 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff 1G Apr 14 03:05:20 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "cinder-591c044a-9b40-43df-8350-09b6396e3915-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-591c044a-9b40-43df-8350-09b6396e3915-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "cinder-quobyte-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-quobyte-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "cinder-quobyte-591c044a-9b40-43df-8350-09b6396e3915" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-quobyte-591c044a-9b40-43df-8350-09b6396e3915" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Deleting offline snapshot 591c044a-9b40-43df-8350-09b6396e3915 of volume ba8859a5-fb69-4cf0-a774-9fe2187a42d8 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] snapshot_file for this snap is: volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9745ba-fd7b-4f04-81d5-015a6c00b1e1]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:21 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff 1G" returned: 0 in 0.529s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:21 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 Apr 14 03:05:21 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:21 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff Apr 14 03:05:21 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:21 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:21 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff" returned: 0 in 0.434s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:21 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff is being set with open permissions: ugo+rw Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5221218e-017a-47ac-a1e0-77d2455c7a1e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:21 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff Apr 14 03:05:21 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:21 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 Apr 14 03:05:21 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:22 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff" returned: 0 in 0.405s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:22 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.info Apr 14 03:05:22 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:22 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:22 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 Apr 14 03:05:22 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:22 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.info" returned: 0 in 0.417s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:22 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.info is being set with open permissions: ugo+rw Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:22 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.info Apr 14 03:05:22 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:22 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915" returned: 0 in 0.499s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:22 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915 Apr 14 03:05:22 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:22 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.info" returned: 0 in 0.418s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.018s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-41777321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da4cc4f-3181-4127-a817-03a69666feb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27eee834dc174e30aa171f3e00c0d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:20Z,use_quota=True,user_id='135c94fc4f8a49b38ecf16c62bfc6ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Creating volume 6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:22 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:22 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f946bd39-70a4-4866-b3c9-5066f7413711 tempest-VolumesSnapshotListTestJSON-1693618518 None] Create snapshot completed successfully Apr 14 03:05:22 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 1073741824 Apr 14 03:05:22 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:23 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8.591c044a-9b40-43df-8350-09b6396e3915" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-quobyte-591c044a-9b40-43df-8350-09b6396e3915" released by "_delete_snapshot" :: held 1.983s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-quobyte-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" released by "delete_snapshot" :: held 1.995s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Created reservations ['c2ceb99d-b4e8-4e69-852e-b5ea5bb9c9c7', '8425301e-5583-4fbd-a701-d5ded183c00d', '6a90b1c9-0431-4ee8-a058-31dfff5a7424', 'dfba4f7b-0e70-44ec-a785-3b84e4fdcc2d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Delete snapshot completed successfully. Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-78d655a5-5d34-41fc-8cb5-f4156b99be89 tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-591c044a-9b40-43df-8350-09b6396e3915-delete_snapshot" released by "delete_snapshot" :: held 2.078s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:23 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 1073741824" returned: 0 in 0.540s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:23 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 Apr 14 03:05:23 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:23 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0" returned: 0 in 0.449s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de63271-b800-4d0a-874c-b6a99ca169d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da4cc4f-3181-4127-a817-03a69666feb0', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5408e360-ef6a-48ae-9fe4-d062a5597d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:23 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Volume volume-6da4cc4f-3181-4127-a817-03a69666feb0 (6da4cc4f-3181-4127-a817-03a69666feb0): created successfully Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5408e360-ef6a-48ae-9fe4-d062a5597d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (b7724a88-12f4-4d1c-8ab5-f882133ae269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ee2507d4-7229-4487-9704-774f77932aee tempest-VolumesSnapshotTestJSON-188249116 None] Created volume successfully. Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Creating offline snapshot cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 of volume 735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a20063-db35-4a5e-9eaa-77a7cad4fe59]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:24 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff Apr 14 03:05:24 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "cinder-ba8859a5-fb69-4cf0-a774-9fe2187a42d8-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-ba8859a5-fb69-4cf0-a774-9fe2187a42d8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "cinder-quobyte-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-quobyte-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c9049-d70b-47ef-8459-a46151c83e0e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:24 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 Apr 14 03:05:24 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:24 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff" returned: 0 in 0.540s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735a8f18-337e-4816-9868-224ef6946e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:24 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 1G Apr 14 03:05:24 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:24 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:24 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8 Apr 14 03:05:24 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:25 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 1G" returned: 0 in 0.482s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:25 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 Apr 14 03:05:25 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:25 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-quobyte-ba8859a5-fb69-4cf0-a774-9fe2187a42d8" released by "delete_volume" :: held 0.929s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Created reservations ['eb12f52d-d160-4e5a-9cf2-94581e76c159', 'd9a0df5f-db79-4fe2-9961-0c1163809de9', '0a772357-cfc3-4df7-ab4f-5b61e68017c7', '2942fc24-6523-4ba7-a1af-f43961bc6587'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:25 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:25 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:25 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" returned: 0 in 0.475s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:25 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 is being set with open permissions: ugo+rw Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:25 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 Apr 14 03:05:25 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:25 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.475s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:25 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Deleted volume successfully. Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e9c463f8-5364-4b30-a54f-4e3b060df70f tempest-SnapshotMetadataTestJSON-158796200 None] Lock "cinder-ba8859a5-fb69-4cf0-a774-9fe2187a42d8-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:25 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" returned: 0 in 0.466s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.853s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Creating offline snapshot 5ede98fe-dc81-4351-bf60-8b539235270d of volume 6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:26 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d229231c-4a9c-4558-bd0a-f7979807399b tempest-VolumesSnapshotListTestJSON-1693618518 None] Create snapshot completed successfully Apr 14 03:05:26 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8ecad0-97fa-457c-96a3-cea4520a6f7b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:26 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 Apr 14 03:05:26 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:26 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0" returned: 0 in 0.498s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:26 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d 1G Apr 14 03:05:26 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d 1G" returned: 0 in 0.496s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da4cc4f-3181-4127-a817-03a69666feb0 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:27 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:27 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da4cc4f-3181-4127-a817-03a69666feb0 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d Apr 14 03:05:27 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:27 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da4cc4f-3181-4127-a817-03a69666feb0 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d" returned: 0 in 0.498s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:27 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d is being set with open permissions: ugo+rw Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:27 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d Apr 14 03:05:27 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Flow 'volume_create_manager' (9a8a0a75-90cd-42f4-a50c-34056a9f9045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6708810-c1ec-474c-a230-bada5e5eac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6708810-c1ec-474c-a230-bada5e5eac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-874033765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28074f88-5424-424a-8ed3-7ec8ef73b7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2bc5686ccc843658ddecd0e375d7bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:28Z,use_quota=True,user_id='fd6b491ee9ec4264ad1699bfa68241c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c7df00-7dd2-4be3-b5ab-b0fdfee67e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c7df00-7dd2-4be3-b5ab-b0fdfee67e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e1b6a2-5405-4710-ad5f-4b7dde4ee7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e1b6a2-5405-4710-ad5f-4b7dde4ee7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28074f88-5424-424a-8ed3-7ec8ef73b7b0', 'volume_name': 'volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf41d5e-5d4d-419e-b3d1-c376c15cd45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf41d5e-5d4d-419e-b3d1-c376c15cd45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75773d9f-d5d4-4403-b632-6f185add4796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:27 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Volume 28074f88-5424-424a-8ed3-7ec8ef73b7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0', 'volume_size': 1} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:27 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:27 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.info Apr 14 03:05:27 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:28 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.info" returned: 0 in 0.417s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:28 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.info is being set with open permissions: ugo+rw Apr 14 03:05:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:28 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.info Apr 14 03:05:28 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:28 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.info" returned: 0 in 0.396s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.800s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.603s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Creating offline snapshot b354592c-6e46-483a-a59a-b33c245559cc of volume 735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:28 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-fd17fbf8-1dd8-4f92-8889-d4deb5f47a75 tempest-VolumesSnapshotTestJSON-188249116 None] Create snapshot completed successfully Apr 14 03:05:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f513b31b-5ba0-4bda-9c0a-e84f99b5b8bf]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:28 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 Apr 14 03:05:28 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:29 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" returned: 0 in 0.486s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735a8f18-337e-4816-9868-224ef6946e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:29 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc 1G Apr 14 03:05:29 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (94b51d9d-bd8d-4f94-af54-ec383dad961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3045646d-011a-4b7c-8384-28eb01b4dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3045646d-011a-4b7c-8384-28eb01b4dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1141401247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59718964-7000-4cc0-a004-98e2b01ef950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27eee834dc174e30aa171f3e00c0d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5ede98fe-dc81-4351-bf60-8b539235270d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:30Z,use_quota=True,user_id='135c94fc4f8a49b38ecf16c62bfc6ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94483022-918c-4145-b1d7-d3fcc0bc9575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94483022-918c-4145-b1d7-d3fcc0bc9575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16550e5c-1a73-4103-b033-c7650d5dca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16550e5c-1a73-4103-b033-c7650d5dca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59718964-7000-4cc0-a004-98e2b01ef950', 'volume_name': 'volume-59718964-7000-4cc0-a004-98e2b01ef950', 'volume_size': 2, 'snapshot_id': '5ede98fe-dc81-4351-bf60-8b539235270d'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1111f03d-b960-4100-9f65-72998106e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1111f03d-b960-4100-9f65-72998106e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccf2ffd-bdcb-4555-9440-3c3bd40fb350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:29 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Volume 59718964-7000-4cc0-a004-98e2b01ef950: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59718964-7000-4cc0-a004-98e2b01ef950', 'volume_size': 2, 'snapshot_id': '5ede98fe-dc81-4351-bf60-8b539235270d'} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:29 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc 1G" returned: 0 in 0.513s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:29 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc Apr 14 03:05:29 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:30 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc" returned: 0 in 0.432s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:30 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc is being set with open permissions: ugo+rw Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:30 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc Apr 14 03:05:30 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:30 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc" returned: 0 in 0.465s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-874033765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28074f88-5424-424a-8ed3-7ec8ef73b7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2bc5686ccc843658ddecd0e375d7bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:28Z,use_quota=True,user_id='fd6b491ee9ec4264ad1699bfa68241c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Creating volume 28074f88-5424-424a-8ed3-7ec8ef73b7b0 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:30 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:30 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f79620de-5d2e-40fa-bf19-7fda85f3a9d3 tempest-VolumesSnapshotListTestJSON-1693618518 None] Create snapshot completed successfully Apr 14 03:05:30 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 1073741824 Apr 14 03:05:30 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:31 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 1073741824" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:31 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 Apr 14 03:05:31 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:31 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0" returned: 0 in 0.457s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.072s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-5ede98fe-dc81-4351-bf60-8b539235270d-59718964-7000-4cc0-a004-98e2b01ef950" by "_create_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75773d9f-d5d4-4403-b632-6f185add4796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cf3b45-537d-45fc-be20-d8aada3034de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Volume volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 (28074f88-5424-424a-8ed3-7ec8ef73b7b0): created successfully Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cf3b45-537d-45fc-be20-d8aada3034de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Flow 'volume_create_manager' (9a8a0a75-90cd-42f4-a50c-34056a9f9045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-4399b30e-c3ea-4fd9-b109-1cba771afc1a tempest-VolumesTransfersTest-311299066 None] Created volume successfully. Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-5ede98fe-dc81-4351-bf60-8b539235270d-59718964-7000-4cc0-a004-98e2b01ef950" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Creating volume 59718964-7000-4cc0-a004-98e2b01ef950 from snapshot 5ede98fe-dc81-4351-bf60-8b539235270d {{(pid=82473) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-59718964-7000-4cc0-a004-98e2b01ef950" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-59718964-7000-4cc0-a004-98e2b01ef950" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] snapshot: 5ede98fe-dc81-4351-bf60-8b539235270d, volume: 59718964-7000-4cc0-a004-98e2b01ef950, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[98859af6-cae5-4ca5-8945-b7c961096083]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:31 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d Apr 14 03:05:31 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-b354592c-6e46-483a-a59a-b33c245559cc-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-b354592c-6e46-483a-a59a-b33c245559cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-quobyte-b354592c-6e46-483a-a59a-b33c245559cc" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-b354592c-6e46-483a-a59a-b33c245559cc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Deleting offline snapshot b354592c-6e46-483a-a59a-b33c245559cc of volume 735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] snapshot_file for this snap is: volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[25306104-09ff-4610-b9be-616d9b19fa2c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:32 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc Apr 14 03:05:32 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:32 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da4cc4f-3181-4127-a817-03a69666feb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adb2687-9237-4d55-a2ea-f73b8f199fcf]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:32 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 Apr 14 03:05:32 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3a06b17d-9aeb-47a1-9019-35964b58787e tempest-VolumesTransfersTest-295784019 None] Transfer volume completed successfully. Apr 14 03:05:32 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc" returned: 0 in 0.508s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735a8f18-337e-4816-9868-224ef6946e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[db999848-f51f-44a7-a477-aacb7fe7633b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:32 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 Apr 14 03:05:32 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:32 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0" returned: 0 in 0.527s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:32 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 Apr 14 03:05:32 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:32 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" returned: 0 in 0.489s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735a8f18-337e-4816-9868-224ef6946e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:32 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc Apr 14 03:05:32 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Acquiring lock "cinder-28074f88-5424-424a-8ed3-7ec8ef73b7b0-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Lock "cinder-28074f88-5424-424a-8ed3-7ec8ef73b7b0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Acquiring lock "cinder-quobyte-28074f88-5424-424a-8ed3-7ec8ef73b7b0" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Lock "cinder-quobyte-28074f88-5424-424a-8ed3-7ec8ef73b7b0" acquired by "delete_volume" :: waited 0.017s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:33 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf540f1f-7b22-4591-aea5-3f608f96652a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:33 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 Apr 14 03:05:33 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:34 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc" returned: 0 in 1.216s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:34 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc Apr 14 03:05:34 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:34 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0" returned: 0 in 1.561s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:34 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0 Apr 14 03:05:34 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:35 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950" returned: 0 in 2.215s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bda5d7-f3d1-4887-ab7f-4167910b68c5]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:35 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.b354592c-6e46-483a-a59a-b33c245559cc" returned: 0 in 0.899s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-b354592c-6e46-483a-a59a-b33c245559cc" released by "_delete_snapshot" :: held 3.160s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" released by "delete_snapshot" :: held 3.170s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Created reservations ['459bf882-893f-48a9-930c-2babab0e01f8', '2e54f6ea-657b-4f01-9898-788de8063ad3', 'bc86affd-0ca6-43b3-aad0-20056f8cbe03', '207a20b7-15c7-41d9-9b88-0887b8018f6d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:35 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 Apr 14 03:05:35 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Delete snapshot completed successfully. Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5af47a48-3863-44cd-b295-cde042a5828a tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-b354592c-6e46-483a-a59a-b33c245559cc-delete_snapshot" released by "delete_snapshot" :: held 3.265s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-quobyte-cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Deleting offline snapshot cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 of volume 735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] snapshot_file for this snap is: volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fb7eb8-3b4c-413c-b486-ad9af7fcfe14]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:35 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 Apr 14 03:05:35 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:35 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-28074f88-5424-424a-8ed3-7ec8ef73b7b0" returned: 0 in 0.532s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Lock "cinder-quobyte-28074f88-5424-424a-8ed3-7ec8ef73b7b0" released by "delete_volume" :: held 2.122s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Created reservations ['f14e03a0-98aa-47ad-8b16-b0d420ab6383', '022f1591-4676-4acb-b8f1-740ac8bdffbd', '6f3f377d-c82c-42a7-b5f9-3c966c1bd02a', 'd6d18291-f5d8-46cb-86a0-97ab30df2340'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:35 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:35 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:35 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0" returned: 0 in 0.689s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:05:35 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Converted 1024.00 MB image at 461.98 MB/s Apr 14 03:05:35 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 is being set with open permissions: ugo+rw Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:35 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 Apr 14 03:05:35 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:35 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" returned: 0 in 0.596s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735a8f18-337e-4816-9868-224ef6946e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Flow 'volume_create_manager' (c70e3e12-cec7-4de0-becc-7249c241c454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d6454a-4ea1-454b-9dcf-bf5f3774bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[da90a9cc-f1e7-4a12-a3c5-6a9f94b42f22]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d6454a-4ea1-454b-9dcf-bf5f3774bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-514001792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342c181e-1d67-491b-94bc-dcf3844f83e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2bc5686ccc843658ddecd0e375d7bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:36Z,use_quota=True,user_id='fd6b491ee9ec4264ad1699bfa68241c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae26664-756c-4392-8408-e918681212f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae26664-756c-4392-8408-e918681212f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0be84c7-0c2f-4b89-b53e-cdef2dfec5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0be84c7-0c2f-4b89-b53e-cdef2dfec5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342c181e-1d67-491b-94bc-dcf3844f83e9', 'volume_name': 'volume-342c181e-1d67-491b-94bc-dcf3844f83e9', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8edcdd8-ab0d-45f1-99fe-a8c2ce33bd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8edcdd8-ab0d-45f1-99fe-a8c2ce33bd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7922366f-eb72-4288-9e49-cd8ac61ce5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:35 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Volume 342c181e-1d67-491b-94bc-dcf3844f83e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342c181e-1d67-491b-94bc-dcf3844f83e9', 'volume_size': 1} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:35 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.468s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:35 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Deleted volume successfully. Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b4693518-b350-424d-9a5f-77cbf72fa22b tempest-VolumesTransfersTest-1055580746 None] Lock "cinder-28074f88-5424-424a-8ed3-7ec8ef73b7b0-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:36 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff Apr 14 03:05:36 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:36 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-59718964-7000-4cc0-a004-98e2b01ef950" released by "_copy_volume_from_snapshot" :: held 4.451s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-5ede98fe-dc81-4351-bf60-8b539235270d-59718964-7000-4cc0-a004-98e2b01ef950" released by "_create_volume_from_snapshot" :: held 4.467s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.507s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-514001792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342c181e-1d67-491b-94bc-dcf3844f83e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2bc5686ccc843658ddecd0e375d7bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:36Z,use_quota=True,user_id='fd6b491ee9ec4264ad1699bfa68241c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Creating volume 342c181e-1d67-491b-94bc-dcf3844f83e9 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:36 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:36 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 1073741824 Apr 14 03:05:36 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ccf2ffd-bdcb-4555-9440-3c3bd40fb350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59718964-7000-4cc0-a004-98e2b01ef950', 'volume_size': 2, 'snapshot_id': '5ede98fe-dc81-4351-bf60-8b539235270d'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15699b34-f9ce-4929-8578-dcec44320502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:36 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Volume volume-59718964-7000-4cc0-a004-98e2b01ef950 (59718964-7000-4cc0-a004-98e2b01ef950): created successfully Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15699b34-f9ce-4929-8578-dcec44320502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (94b51d9d-bd8d-4f94-af54-ec383dad961a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:36 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-97b0c4d9-eff7-479f-8962-b75d2b2866e7 tempest-VolumesSnapshotTestJSON-188249116 None] Created volume successfully. Apr 14 03:05:36 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff" returned: 0 in 0.506s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735a8f18-337e-4816-9868-224ef6946e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:36 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 Apr 14 03:05:36 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:36 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 1073741824" returned: 0 in 0.492s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:36 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 Apr 14 03:05:36 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:36 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" returned: 0 in 0.494s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:36 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7 Apr 14 03:05:36 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-59718964-7000-4cc0-a004-98e2b01ef950-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:37 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-59718964-7000-4cc0-a004-98e2b01ef950-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9" returned: 0 in 0.434s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7922366f-eb72-4288-9e49-cd8ac61ce5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342c181e-1d67-491b-94bc-dcf3844f83e9', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d33b68c-e1c1-42f6-8045-878ee6611e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:37 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Volume volume-342c181e-1d67-491b-94bc-dcf3844f83e9 (342c181e-1d67-491b-94bc-dcf3844f83e9): created successfully Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d33b68c-e1c1-42f6-8045-878ee6611e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Flow 'volume_create_manager' (c70e3e12-cec7-4de0-becc-7249c241c454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-59718964-7000-4cc0-a004-98e2b01ef950" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:37 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6637baae-987c-46f1-9975-5f670eaca89d tempest-VolumesTransfersTest-311299066 None] Created volume successfully. Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-59718964-7000-4cc0-a004-98e2b01ef950" acquired by "delete_volume" :: waited 0.017s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[98085e75-afae-494f-ac5a-696fe0dc037f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:37 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 Apr 14 03:05:37 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:37 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" returned: 0 in 0.418s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7" released by "_delete_snapshot" :: held 2.100s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" released by "delete_snapshot" :: held 2.117s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Created reservations ['bb1ff71e-c0a1-4bd5-84bd-7dbab3d59af2', 'db7bde88-4069-4997-9687-7c14544590b3', '40857ada-7f64-4b83-ab63-9d561c7fb419', 'a61ac227-cb57-4863-ac01-05f2b2616068'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:37 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Delete snapshot completed successfully. Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-5d8473c8-214d-42b1-ba68-5865bcb100f0 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-cb971ed0-a889-4dfd-a8eb-0f35d79e3dc7-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:37 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950" returned: 0 in 0.490s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:37 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950 Apr 14 03:05:37 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Acquiring lock "cinder-342c181e-1d67-491b-94bc-dcf3844f83e9-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Lock "cinder-342c181e-1d67-491b-94bc-dcf3844f83e9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Acquiring lock "cinder-quobyte-342c181e-1d67-491b-94bc-dcf3844f83e9" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:38 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Lock "cinder-quobyte-342c181e-1d67-491b-94bc-dcf3844f83e9" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-59718964-7000-4cc0-a004-98e2b01ef950" returned: 0 in 0.465s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc39b2-a53e-4327-aba7-e57d55b3e1ee]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-59718964-7000-4cc0-a004-98e2b01ef950" released by "delete_volume" :: held 0.984s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Created reservations ['5dabe344-b32c-4cfa-b9a3-783ee23205b7', 'cc44178d-4a96-4159-bd77-aca8df94d386', '1b25dafc-ee08-4ebf-b341-372556871c8c', 'b5d18d22-c780-4148-af00-08e19937c5c1'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:38 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 Apr 14 03:05:38 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:38 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:38 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-4c8e719c-5798-4de0-87b1-afb08346fbff-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-4c8e719c-5798-4de0-87b1-afb08346fbff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-quobyte-4c8e719c-5798-4de0-87b1-afb08346fbff" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-4c8e719c-5798-4de0-87b1-afb08346fbff" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Deleting offline snapshot 4c8e719c-5798-4de0-87b1-afb08346fbff of volume 735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] snapshot_file for this snap is: volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb7b1e-da5b-4604-9b0e-682764cab088]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:38 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff Apr 14 03:05:38 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:38 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9" returned: 0 in 0.499s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:38 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9 Apr 14 03:05:38 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:38 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.448s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Deleted volume successfully. Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a82ac07a-3547-4eec-839c-8ec4f538dff3 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-59718964-7000-4cc0-a004-98e2b01ef950-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:38 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff" returned: 0 in 0.461s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-735a8f18-337e-4816-9868-224ef6946e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b07c85b-55be-4748-affa-582f43276f60]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:38 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d Apr 14 03:05:38 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:39 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-342c181e-1d67-491b-94bc-dcf3844f83e9" returned: 0 in 0.454s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Lock "cinder-quobyte-342c181e-1d67-491b-94bc-dcf3844f83e9" released by "delete_volume" :: held 0.976s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Created reservations ['d8c3d60b-8069-487b-906b-d64be6bfcc49', '36f20c4b-5725-4102-9116-37c6c6b8a2ff', '6caaa352-a91f-4084-af86-96a7f77d13a0', '86d25b21-610e-498c-b6b4-c3700c9bbd19'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:39 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:39 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-5ede98fe-dc81-4351-bf60-8b539235270d-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:39 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d" returned: 0 in 0.483s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-5ede98fe-dc81-4351-bf60-8b539235270d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-6da4cc4f-3181-4127-a817-03a69666feb0" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:39 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff Apr 14 03:05:39 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-6da4cc4f-3181-4127-a817-03a69666feb0" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-5ede98fe-dc81-4351-bf60-8b539235270d" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-5ede98fe-dc81-4351-bf60-8b539235270d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Deleting offline snapshot 5ede98fe-dc81-4351-bf60-8b539235270d of volume 6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] snapshot_file for this snap is: volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[8def62c5-9a63-4d80-88a3-04f4374f1055]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:39 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d Apr 14 03:05:39 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:39 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.439s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:39 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Deleted volume successfully. Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d928f-9826-497b-bf4f-5422639146c9 tempest-VolumesTransfersTest-1055580746 None] Lock "cinder-342c181e-1d67-491b-94bc-dcf3844f83e9-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:39 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff" returned: 0 in 0.484s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:39 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff Apr 14 03:05:39 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:39 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da4cc4f-3181-4127-a817-03a69666feb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6edc9b-4d7b-405d-86a1-61ff60b3e5dc]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:40 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 Apr 14 03:05:40 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:40 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d.4c8e719c-5798-4de0-87b1-afb08346fbff" returned: 0 in 0.393s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-4c8e719c-5798-4de0-87b1-afb08346fbff" released by "_delete_snapshot" :: held 1.878s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" released by "delete_snapshot" :: held 1.893s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Created reservations ['1ae79503-40af-46cd-88e4-5d7fdceb606a', '187aaab5-a267-47b1-ac1c-c6aa7c833fa5', '7524ec34-932a-4a09-99a0-cbcc40e56ca6', 'c80e50cf-3ccf-4556-9673-225a08a3133e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:40 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Delete snapshot completed successfully. Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8b3d4c77-374b-4e79-b899-7d33054797f5 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-4c8e719c-5798-4de0-87b1-afb08346fbff-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:40 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0" returned: 0 in 0.494s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:40 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d Apr 14 03:05:40 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-735a8f18-337e-4816-9868-224ef6946e1d-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-735a8f18-337e-4816-9868-224ef6946e1d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f888f-4682-4eed-a92c-131729970e9b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:40 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d Apr 14 03:05:40 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:40 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d" returned: 0 in 0.539s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:40 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d Apr 14 03:05:40 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:41 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d" returned: 0 in 0.568s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:41 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d Apr 14 03:05:41 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:41 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0.5ede98fe-dc81-4351-bf60-8b539235270d" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-5ede98fe-dc81-4351-bf60-8b539235270d" released by "_delete_snapshot" :: held 2.063s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-6da4cc4f-3181-4127-a817-03a69666feb0" released by "delete_snapshot" :: held 2.076s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Created reservations ['29a59afb-cd37-4a1d-997d-36ae31e36ab8', 'a47d2be9-d76b-43fc-942b-332c2c98884e', '6aafb104-41a4-4962-a85d-438a20567359', 'a789a850-7c9b-47b3-9072-f62bfa74432d'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:41 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Delete snapshot completed successfully. Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e914340-4360-4c59-bed7-c295e26061b5 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-5ede98fe-dc81-4351-bf60-8b539235270d-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:41 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-735a8f18-337e-4816-9868-224ef6946e1d" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-quobyte-735a8f18-337e-4816-9868-224ef6946e1d" released by "delete_volume" :: held 1.081s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Created reservations ['c45cff9b-9ac1-4141-bd56-c599cd110370', 'c77cb2e8-5502-4568-afee-98806fbdf0cc', 'b026eb51-d78e-49e4-a486-a60a2ae337ad', 'dceedc3f-c222-4f71-ace3-d822fd1ea61e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:41 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:41 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:42 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.457s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:42 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Deleted volume successfully. Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34aca290-1bf6-4ac3-800e-efc51eb8b139 tempest-VolumesSnapshotListTestJSON-1693618518 None] Lock "cinder-735a8f18-337e-4816-9868-224ef6946e1d-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-6da4cc4f-3181-4127-a817-03a69666feb0-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-6da4cc4f-3181-4127-a817-03a69666feb0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-6da4cc4f-3181-4127-a817-03a69666feb0" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-6da4cc4f-3181-4127-a817-03a69666feb0" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[006c98fe-4858-42df-8d08-1a5cf18c77b5]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:42 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 Apr 14 03:05:42 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:43 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0" returned: 0 in 0.559s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:43 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0 Apr 14 03:05:43 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (aa1d121d-a783-44a3-a88e-cbf42412e3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dfd6c4-5858-4848-ac22-2b88b5b4fe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dfd6c4-5858-4848-ac22-2b88b5b4fe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2079166721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff17b6f-09a8-464a-9672-75bdce69ca1a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:44Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8454258-9ab5-4c00-b3ed-ae70d87a0fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8454258-9ab5-4c00-b3ed-ae70d87a0fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64a7fa8-c07c-40a9-a631-18423dca4704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64a7fa8-c07c-40a9-a631-18423dca4704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff17b6f-09a8-464a-9672-75bdce69ca1a', 'volume_name': 'volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0503c81-5305-49fb-af95-0a81cc06c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0503c81-5305-49fb-af95-0a81cc06c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b35c9bc-b8e5-40df-af98-5a84e6744420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:43 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Volume 9ff17b6f-09a8-464a-9672-75bdce69ca1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a', 'volume_size': 1} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2079166721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff17b6f-09a8-464a-9672-75bdce69ca1a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:44Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Creating volume 9ff17b6f-09a8-464a-9672-75bdce69ca1a {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:43 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:43 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a 1073741824 Apr 14 03:05:43 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:43 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-6da4cc4f-3181-4127-a817-03a69666feb0" returned: 0 in 0.565s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-6da4cc4f-3181-4127-a817-03a69666feb0" released by "delete_volume" :: held 1.169s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Created reservations ['67b870af-fabe-40de-9b4d-33b33ea321d2', '7c133c59-d5d2-4578-aeb3-16fb1778ad2b', 'f84cbc46-eb8d-401b-9c1b-970f30934c89', 'f8c44e0c-f86a-4b27-9011-d5a211e462cc'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:43 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:43 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:44 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a 1073741824" returned: 0 in 0.538s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:44 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a Apr 14 03:05:44 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:44 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:44 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Deleted volume successfully. Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-10d5d9d6-92c5-43ab-8a17-6b1296225149 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-6da4cc4f-3181-4127-a817-03a69666feb0-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Flow 'volume_create_manager' (f898bf74-d6e2-4b09-a62e-53e1150dc7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372c582a-2443-4c65-9005-ad5bc0c8d95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372c582a-2443-4c65-9005-ad5bc0c8d95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-144774069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f191dcf4-690b-4c31-a53a-670048d8c8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ebe84136ccc45d991e507838fed81a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:45Z,use_quota=True,user_id='e2f057bc215642c28d04e3bfc062c8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5841fe37-94e2-4276-a4a0-86d9e68c7056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5841fe37-94e2-4276-a4a0-86d9e68c7056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32eb5297-c67a-4256-aee4-998c56571c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32eb5297-c67a-4256-aee4-998c56571c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f191dcf4-690b-4c31-a53a-670048d8c8bf', 'volume_name': 'volume-f191dcf4-690b-4c31-a53a-670048d8c8bf', 'volume_size': 2}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36e2084-7e4a-4159-8b16-c4dc693f01ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36e2084-7e4a-4159-8b16-c4dc693f01ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584c5ebd-6481-4e98-95c9-ccd4013b0de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:44 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Volume f191dcf4-690b-4c31-a53a-670048d8c8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f191dcf4-690b-4c31-a53a-670048d8c8bf', 'volume_size': 2} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:44 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a" returned: 0 in 0.513s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.069s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-144774069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f191dcf4-690b-4c31-a53a-670048d8c8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ebe84136ccc45d991e507838fed81a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:45Z,use_quota=True,user_id='e2f057bc215642c28d04e3bfc062c8e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Creating volume f191dcf4-690b-4c31-a53a-670048d8c8bf {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:44 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf 2147483648 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b35c9bc-b8e5-40df-af98-5a84e6744420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5a4266-6bec-49c4-8b40-c67785dc0b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:44 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf 2147483648 Apr 14 03:05:44 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:44 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Volume volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a (9ff17b6f-09a8-464a-9672-75bdce69ca1a): created successfully Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5a4266-6bec-49c4-8b40-c67785dc0b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (aa1d121d-a783-44a3-a88e-cbf42412e3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:44 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-1d8046f3-7f91-4ff9-8dfa-1bfb403305be tempest-VolumesGetTest-1479952312 None] Created volume successfully. Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (fdfa2512-3b3f-4c1c-a26c-1992bdc0e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a0808f-bde6-417d-bc07-742adf64ee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a0808f-bde6-417d-bc07-742adf64ee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2091712576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6ccb14-a1ee-42a6-bc44-32c7f8456389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27eee834dc174e30aa171f3e00c0d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:45Z,use_quota=True,user_id='135c94fc4f8a49b38ecf16c62bfc6ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd6ef50-5c2c-40d8-b45e-a9c3d9f4a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd6ef50-5c2c-40d8-b45e-a9c3d9f4a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa0fb66-5901-4c90-a21e-dce86e9fafcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa0fb66-5901-4c90-a21e-dce86e9fafcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f6ccb14-a1ee-42a6-bc44-32c7f8456389', 'volume_name': 'volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e01902-6a10-4de4-8937-24816653bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e01902-6a10-4de4-8937-24816653bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d706bf5-3117-4aa6-ba20-2cd5440fbd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:45 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Volume 5f6ccb14-a1ee-42a6-bc44-32c7f8456389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389', 'volume_size': 1} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:45 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf 2147483648" returned: 0 in 0.525s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:45 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf Apr 14 03:05:45 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:45 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf" returned: 0 in 0.437s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2091712576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f6ccb14-a1ee-42a6-bc44-32c7f8456389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27eee834dc174e30aa171f3e00c0d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:45Z,use_quota=True,user_id='135c94fc4f8a49b38ecf16c62bfc6ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Creating volume 5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:45 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584c5ebd-6481-4e98-95c9-ccd4013b0de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f191dcf4-690b-4c31-a53a-670048d8c8bf', 'volume_size': 2}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:45 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 1073741824 Apr 14 03:05:45 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e281322d-64a9-48de-a266-e9869e07e5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:45 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Volume volume-f191dcf4-690b-4c31-a53a-670048d8c8bf (f191dcf4-690b-4c31-a53a-670048d8c8bf): created successfully Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e281322d-64a9-48de-a266-e9869e07e5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:45 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Flow 'volume_create_manager' (f898bf74-d6e2-4b09-a62e-53e1150dc7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:45 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-dc5bfb0d-30a5-49a9-8855-b87292f10d1d tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Created volume successfully. Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (b7b3b672-bf27-43a3-ab4a-63b41f07aa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cfe950-bd10-4ba3-89a4-260bf5460eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cfe950-bd10-4ba3-89a4-260bf5460eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-492770532',display_name='tempest-VolumesGetTest-Volume-1287643498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116020ce-59b8-4851-8a07-137876285343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:46Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1388dfc9-3cff-4c1c-a10a-855d94e6d905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1388dfc9-3cff-4c1c-a10a-855d94e6d905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ab2de9-ec9c-405f-8f0f-0b96cb27f931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ab2de9-ec9c-405f-8f0f-0b96cb27f931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116020ce-59b8-4851-8a07-137876285343', 'volume_name': 'volume-116020ce-59b8-4851-8a07-137876285343', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099c7bd5-f63b-461a-9e78-bc7ed06a2027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099c7bd5-f63b-461a-9e78-bc7ed06a2027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b306c834-64ae-482b-a7cb-6328bc830e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:46 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Volume 116020ce-59b8-4851-8a07-137876285343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116020ce-59b8-4851-8a07-137876285343', 'volume_size': 1} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:46 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 1073741824" returned: 0 in 0.544s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:46 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 Apr 14 03:05:46 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:46 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" returned: 0 in 0.447s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-492770532',display_name='tempest-VolumesGetTest-Volume-1287643498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116020ce-59b8-4851-8a07-137876285343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:46Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Creating volume 116020ce-59b8-4851-8a07-137876285343 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:46 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:46 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 1073741824 Apr 14 03:05:46 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d706bf5-3117-4aa6-ba20-2cd5440fbd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e42b53-bb96-4029-9a10-05511ff5d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:46 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Volume volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 (5f6ccb14-a1ee-42a6-bc44-32c7f8456389): created successfully Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e42b53-bb96-4029-9a10-05511ff5d39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (fdfa2512-3b3f-4c1c-a26c-1992bdc0e188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:46 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-37113084-6395-425d-b254-8ed2f5bbb573 tempest-VolumesSnapshotTestJSON-188249116 None] Created volume successfully. Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:47 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 1073741824" returned: 0 in 0.519s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:47 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 Apr 14 03:05:47 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:47 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343" returned: 0 in 0.417s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.907s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b306c834-64ae-482b-a7cb-6328bc830e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116020ce-59b8-4851-8a07-137876285343', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbba1a69-d778-46fc-ab86-931cc7582c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Creating offline snapshot 99a41b97-f647-407b-a8ce-13b452014152 of volume f191dcf4-690b-4c31-a53a-670048d8c8bf {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:47 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Volume volume-116020ce-59b8-4851-8a07-137876285343 (116020ce-59b8-4851-8a07-137876285343): created successfully Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbba1a69-d778-46fc-ab86-931cc7582c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (b7b3b672-bf27-43a3-ab4a-63b41f07aa8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea6d2bd-03f3-400f-8f14-b0619da66e4a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:47 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-32af1b2c-4990-4b9f-aed0-8ab2d460171c tempest-VolumesGetTest-1479952312 None] Created volume successfully. Apr 14 03:05:47 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf Apr 14 03:05:47 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-116020ce-59b8-4851-8a07-137876285343-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Lock "cinder-116020ce-59b8-4851-8a07-137876285343-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-116020ce-59b8-4851-8a07-137876285343" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-116020ce-59b8-4851-8a07-137876285343" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:48 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf" returned: 0 in 0.511s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 2G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dba62e9-281c-4a2f-8dbb-ac88b2cef3ce]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:48 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 2G Apr 14 03:05:48 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:48 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 Apr 14 03:05:48 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:48 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 2G" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f191dcf4-690b-4c31-a53a-670048d8c8bf -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:48 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f191dcf4-690b-4c31-a53a-670048d8c8bf -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 Apr 14 03:05:48 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:48 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343" returned: 0 in 0.500s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:48 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343 Apr 14 03:05:48 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:49 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f191dcf4-690b-4c31-a53a-670048d8c8bf -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152" returned: 0 in 0.444s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:49 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 is being set with open permissions: ugo+rw Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:49 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-116020ce-59b8-4851-8a07-137876285343" returned: 0 in 0.423s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-116020ce-59b8-4851-8a07-137876285343" released by "delete_volume" :: held 0.955s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:49 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 Apr 14 03:05:49 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Created reservations ['adf41f72-2513-447f-ac6c-f86ccd73e6c3', 'd5e297ec-4cca-4bab-9cb3-2c08d5c5ae6c', '72aafd8e-39b8-4f61-82dc-8556f6d4b7ad', '9089abf3-fe53-47c1-a7ad-8d2b304357be'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:49 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:49 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-9ff17b6f-09a8-464a-9672-75bdce69ca1a-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Lock "cinder-9ff17b6f-09a8-464a-9672-75bdce69ca1a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-9ff17b6f-09a8-464a-9672-75bdce69ca1a" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-9ff17b6f-09a8-464a-9672-75bdce69ca1a" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ed93c-8346-4939-b597-c35a0fb5db5f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:49 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a Apr 14 03:05:49 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:49 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152" returned: 0 in 0.442s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:49 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.info Apr 14 03:05:49 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:49 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.456s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:49 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Deleted volume successfully. Apr 14 03:05:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-75e4d663-d0bd-46a2-b662-f5e060268f7d tempest-VolumesGetTest-1479952312 None] Lock "cinder-116020ce-59b8-4851-8a07-137876285343-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:50 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:50 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a Apr 14 03:05:50 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:50 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.info" returned: 0 in 0.454s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:50 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.info is being set with open permissions: ugo+rw Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:50 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.info Apr 14 03:05:50 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:50 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ff17b6f-09a8-464a-9672-75bdce69ca1a" returned: 0 in 0.438s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-9ff17b6f-09a8-464a-9672-75bdce69ca1a" released by "delete_volume" :: held 0.947s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Created reservations ['1f646ab7-a05d-4d20-9452-bcb0e69860f6', '5d705a58-a68a-437a-b6e5-02278597599d', '4bbfa9fc-8adb-4303-8dc3-44e088612ca4', 'b6432f2d-9c54-4761-aa84-1ad89a4d0f17'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:50 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:50 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:50 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.info" returned: 0 in 0.445s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.855s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.449s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Creating offline snapshot eb634f04-58e9-4d19-867d-6707665f1cc5 of volume 5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:50 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3a192130-5ee6-4d19-8adc-f89327487d97 tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Create snapshot completed successfully Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e688e7-0e96-411c-8e3a-c945e9233a27]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:50 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 Apr 14 03:05:50 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (ac8d9b62-9346-4973-8cdf-c2a8df13eda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d0d21d-cee8-4bc6-bc04-827eb7356e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d0d21d-cee8-4bc6-bc04-827eb7356e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-59589112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ad7a99-74d1-4942-8108-b518459e0cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:51Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12abf8cd-85a4-40aa-ac84-68a063b70864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12abf8cd-85a4-40aa-ac84-68a063b70864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89a5b14-327d-44a5-ab02-efe0e75819b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89a5b14-327d-44a5-ab02-efe0e75819b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ad7a99-74d1-4942-8108-b518459e0cd3', 'volume_name': 'volume-10ad7a99-74d1-4942-8108-b518459e0cd3', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ebb027-9166-4854-8c8b-9d56ee839bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ebb027-9166-4854-8c8b-9d56ee839bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c410ac8-92db-41f6-8a8d-974af948ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:50 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Volume 10ad7a99-74d1-4942-8108-b518459e0cd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ad7a99-74d1-4942-8108-b518459e0cd3', 'volume_size': 1} Apr 14 03:05:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:51 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.477s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Deleted volume successfully. Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a9b248e5-6c8f-4398-9a2e-c709fa644caa tempest-VolumesGetTest-1479952312 None] Lock "cinder-9ff17b6f-09a8-464a-9672-75bdce69ca1a-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "cinder-99a41b97-f647-407b-a8ce-13b452014152-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-99a41b97-f647-407b-a8ce-13b452014152-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "cinder-quobyte-f191dcf4-690b-4c31-a53a-670048d8c8bf" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-quobyte-f191dcf4-690b-4c31-a53a-670048d8c8bf" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "cinder-quobyte-99a41b97-f647-407b-a8ce-13b452014152" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-quobyte-99a41b97-f647-407b-a8ce-13b452014152" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Deleting offline snapshot 99a41b97-f647-407b-a8ce-13b452014152 of volume f191dcf4-690b-4c31-a53a-670048d8c8bf {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] snapshot_file for this snap is: volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b78ec-5f21-4a3d-abda-472a258394b6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:51 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 Apr 14 03:05:51 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:51 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" returned: 0 in 0.512s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:51 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 1G Apr 14 03:05:51 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:51 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152" returned: 0 in 0.484s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f191dcf4-690b-4c31-a53a-670048d8c8bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b89ab0-1063-49dc-8aa9-f7dc6ba652c8]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:51 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf Apr 14 03:05:51 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:51 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 1G" returned: 0 in 0.485s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:51 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 Apr 14 03:05:51 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:52 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:52 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 Apr 14 03:05:52 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:52 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5" returned: 0 in 0.431s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:52 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 is being set with open permissions: ugo+rw Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:52 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 Apr 14 03:05:52 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:52 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:52 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:52 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152 Apr 14 03:05:52 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:52 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.info Apr 14 03:05:52 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:52 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf.99a41b97-f647-407b-a8ce-13b452014152" returned: 0 in 0.414s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-quobyte-99a41b97-f647-407b-a8ce-13b452014152" released by "_delete_snapshot" :: held 1.902s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-quobyte-f191dcf4-690b-4c31-a53a-670048d8c8bf" released by "delete_snapshot" :: held 1.915s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:53 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.info" returned: 0 in 0.418s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:53 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.info is being set with open permissions: ugo+rw Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:53 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.info Apr 14 03:05:53 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Created reservations ['b9904518-f198-4bc4-82bd-c0c82ed1dbe1', 'bf51cf39-d2f1-437e-949e-691b52ddd76b', '0f40359d-1833-4d00-a954-840e9a47438d', '7c609f22-2505-45ff-8a66-67fec00bf5de'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:53 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Delete snapshot completed successfully. Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9aadbb70-b414-442d-948b-6a530fcf3dca tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-99a41b97-f647-407b-a8ce-13b452014152-delete_snapshot" released by "delete_snapshot" :: held 2.016s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "cinder-f191dcf4-690b-4c31-a53a-670048d8c8bf-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-f191dcf4-690b-4c31-a53a-670048d8c8bf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "cinder-quobyte-f191dcf4-690b-4c31-a53a-670048d8c8bf" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-quobyte-f191dcf4-690b-4c31-a53a-670048d8c8bf" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf94657-4dc1-4646-9768-623c6c75ff01]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:53 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf Apr 14 03:05:53 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:53 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.info" returned: 0 in 0.452s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.589s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-59589112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ad7a99-74d1-4942-8108-b518459e0cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:51Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Creating volume 10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:53 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:53 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 1073741824 Apr 14 03:05:53 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:53 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-18c18fa4-1dd6-43a3-8ae3-786673353dc2 tempest-VolumesSnapshotTestJSON-188249116 None] Create snapshot completed successfully Apr 14 03:05:53 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf" returned: 0 in 0.508s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:53 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf Apr 14 03:05:53 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:53 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 1073741824" returned: 0 in 0.481s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:54 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 Apr 14 03:05:54 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:54 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f191dcf4-690b-4c31-a53a-670048d8c8bf" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-quobyte-f191dcf4-690b-4c31-a53a-670048d8c8bf" released by "delete_volume" :: held 0.981s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Created reservations ['00c74093-973b-4f8b-9aee-823871d7f49a', '7e805087-5dde-4f1c-a4cf-c13e5d78fee4', '5e58abab-6eb7-4025-b2f1-be7ba58114b9', '0f338672-13af-4b09-926c-4d6cd10c4193'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:54 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:05:54 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:54 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c410ac8-92db-41f6-8a8d-974af948ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ad7a99-74d1-4942-8108-b518459e0cd3', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f928d80-3848-46bb-a582-526e3741788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:54 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Volume volume-10ad7a99-74d1-4942-8108-b518459e0cd3 (10ad7a99-74d1-4942-8108-b518459e0cd3): created successfully Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f928d80-3848-46bb-a582-526e3741788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (ac8d9b62-9346-4973-8cdf-c2a8df13eda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:54 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-05f4f368-a69c-418a-bcc5-524443554814 tempest-VolumesGetTest-1479952312 None] Created volume successfully. Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (9c5cbc00-3ba9-47c5-80a6-17d521cba063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47fd34d9-461e-44a0-a0f2-13ce0c6db14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47fd34d9-461e-44a0-a0f2-13ce0c6db14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1704284369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16277d2c-c49a-4721-b7c2-c2a98d170a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27eee834dc174e30aa171f3e00c0d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb634f04-58e9-4d19-867d-6707665f1cc5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:55Z,use_quota=True,user_id='135c94fc4f8a49b38ecf16c62bfc6ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1728686b-597d-4f91-a368-f48240d1e09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1728686b-597d-4f91-a368-f48240d1e09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d65e00a-89ae-4e05-934e-b32e0237d426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d65e00a-89ae-4e05-934e-b32e0237d426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16277d2c-c49a-4721-b7c2-c2a98d170a09', 'volume_name': 'volume-16277d2c-c49a-4721-b7c2-c2a98d170a09', 'volume_size': 1, 'snapshot_id': 'eb634f04-58e9-4d19-867d-6707665f1cc5'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b53fe1-4fce-4da5-b494-8851d9c91984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b53fe1-4fce-4da5-b494-8851d9c91984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78498d6b-1c3b-4240-b4b4-ba7d0ea2294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:54 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Volume 16277d2c-c49a-4721-b7c2-c2a98d170a09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16277d2c-c49a-4721-b7c2-c2a98d170a09', 'volume_size': 1, 'snapshot_id': 'eb634f04-58e9-4d19-867d-6707665f1cc5'} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-eb634f04-58e9-4d19-867d-6707665f1cc5-16277d2c-c49a-4721-b7c2-c2a98d170a09" by "_create_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-eb634f04-58e9-4d19-867d-6707665f1cc5-16277d2c-c49a-4721-b7c2-c2a98d170a09" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Creating volume 16277d2c-c49a-4721-b7c2-c2a98d170a09 from snapshot eb634f04-58e9-4d19-867d-6707665f1cc5 {{(pid=82473) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-16277d2c-c49a-4721-b7c2-c2a98d170a09" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-16277d2c-c49a-4721-b7c2-c2a98d170a09" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] snapshot: eb634f04-58e9-4d19-867d-6707665f1cc5, volume: 16277d2c-c49a-4721-b7c2-c2a98d170a09, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd750a9-f3e5-4ebb-82bb-f5a842d202ab]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:54 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.555s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:05:54 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Deleted volume successfully. Apr 14 03:05:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41113084-30f6-4664-9233-191c3d7f95db tempest-VolumesSnapshotNegativeTestJSON-708955700 None] Lock "cinder-f191dcf4-690b-4c31-a53a-670048d8c8bf-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:54 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 Apr 14 03:05:54 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (c8e28f3a-e91e-4fb1-a62a-8067704bb712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6285edf4-0a6f-42ee-8f9f-6a9e6ebfa78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6285edf4-0a6f-42ee-8f9f-6a9e6ebfa78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1191744202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbe324a-49b2-4ee2-a453-e88e1b18a527,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=10ad7a99-74d1-4942-8108-b518459e0cd3,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:55Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fc8376-6044-4863-aa8d-06daa016816b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fc8376-6044-4863-aa8d-06daa016816b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2db866-1988-41d7-a51b-6e22dfbeb6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2db866-1988-41d7-a51b-6e22dfbeb6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2dbe324a-49b2-4ee2-a453-e88e1b18a527', 'volume_name': 'volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527', 'volume_size': 1, 'source_volid': '10ad7a99-74d1-4942-8108-b518459e0cd3', 'source_volstatus': 'available'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de539ce-36c2-478d-bb79-a830f666b7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de539ce-36c2-478d-bb79-a830f666b7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8272c402-712c-4ca4-bf43-f3dd41301767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:55 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Volume 2dbe324a-49b2-4ee2-a453-e88e1b18a527: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527', 'volume_size': 1, 'source_volid': '10ad7a99-74d1-4942-8108-b518459e0cd3', 'source_volstatus': 'available'} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:55 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5" returned: 0 in 0.580s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc0eee5-d270-44eb-bf32-1b840ee95292]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:55 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 Apr 14 03:05:55 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:56 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" returned: 0 in 0.537s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:56 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 Apr 14 03:05:56 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (f2e29e67-be95-44f5-9e89-cff44a0b33ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b22f6b-bc43-429f-b3cc-d2e54a427135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b22f6b-bc43-429f-b3cc-d2e54a427135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652915403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ca4de9-8b3a-49e1-8c94-fbd29cfb524f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:56Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f641f6-108d-45b6-9551-801a73475433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f641f6-108d-45b6-9551-801a73475433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0824c3-1a85-4699-8a98-858c44f27da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0824c3-1a85-4699-8a98-858c44f27da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ca4de9-8b3a-49e1-8c94-fbd29cfb524f', 'volume_name': 'volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24a275f-6e0f-49e8-b1bd-2401983131d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24a275f-6e0f-49e8-b1bd-2401983131d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29d2d3f-7977-45c2-9cfb-64568f5fb892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:56 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume 03ca4de9-8b3a-49e1-8c94-fbd29cfb524f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f', 'volume_size': 1} Apr 14 03:05:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:05:57 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09" returned: 0 in 1.830s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:57 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[709efd1b-ae5d-4e31-88d9-303752b7fd39]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:57 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 Apr 14 03:05:57 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:58 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" returned: 0 in 0.597s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:05:58 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Converted 1024.00 MB image at 559.18 MB/s Apr 14 03:05:58 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 is being set with open permissions: ugo+rw Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:58 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 Apr 14 03:05:58 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:58 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09" returned: 0 in 0.446s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-16277d2c-c49a-4721-b7c2-c2a98d170a09" released by "_copy_volume_from_snapshot" :: held 4.040s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-eb634f04-58e9-4d19-867d-6707665f1cc5-16277d2c-c49a-4721-b7c2-c2a98d170a09" released by "_create_volume_from_snapshot" :: held 4.060s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.068s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.484s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:05:58 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Cloning volume 10ad7a99-74d1-4942-8108-b518459e0cd3 to volume 2dbe324a-49b2-4ee2-a453-e88e1b18a527 Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78498d6b-1c3b-4240-b4b4-ba7d0ea2294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16277d2c-c49a-4721-b7c2-c2a98d170a09', 'volume_size': 1, 'snapshot_id': 'eb634f04-58e9-4d19-867d-6707665f1cc5'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5297a6-32c4-420a-acbb-64582f330148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Creating offline snapshot e9403835-036a-4ac2-9134-9c1f2b4e8461 of volume 10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:05:58 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Volume volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 (16277d2c-c49a-4721-b7c2-c2a98d170a09): created successfully Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5297a6-32c4-420a-acbb-64582f330148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Flow 'volume_create_manager' (9c5cbc00-3ba9-47c5-80a6-17d521cba063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f138c3d1-0ed6-4061-a4bc-89cd31894705]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b26b73d6-81bf-4866-8d61-841ad9fb58a6 tempest-VolumesSnapshotTestJSON-188249116 None] Created volume successfully. Apr 14 03:05:59 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 Apr 14 03:05:59 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-16277d2c-c49a-4721-b7c2-c2a98d170a09-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-16277d2c-c49a-4721-b7c2-c2a98d170a09-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-16277d2c-c49a-4721-b7c2-c2a98d170a09" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-16277d2c-c49a-4721-b7c2-c2a98d170a09" acquired by "delete_volume" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d151d4-0ab3-4ab8-b83f-8c00115af187]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:59 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 Apr 14 03:05:59 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:59 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3" returned: 0 in 0.507s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:59 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 1G Apr 14 03:05:59 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:59 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09" returned: 0 in 0.501s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:05:59 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09 Apr 14 03:05:59 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:05:59 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 1G" returned: 0 in 0.484s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:05:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10ad7a99-74d1-4942-8108-b518459e0cd3 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:00 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10ad7a99-74d1-4942-8108-b518459e0cd3 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 Apr 14 03:06:00 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:00 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16277d2c-c49a-4721-b7c2-c2a98d170a09" returned: 0 in 0.436s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-16277d2c-c49a-4721-b7c2-c2a98d170a09" released by "delete_volume" :: held 0.957s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Created reservations ['f3ab2e83-e822-406e-b2bc-20fd8691e31b', 'ce23cf6e-52f2-4628-bf5c-9e3b93d4b3df', '84fb4e1d-83b9-40ef-9525-c0c5ce7862fa', '5019d2fd-a843-4c98-ac00-d7adcbef5d14'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:00 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:00 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-eb634f04-58e9-4d19-867d-6707665f1cc5-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-eb634f04-58e9-4d19-867d-6707665f1cc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-eb634f04-58e9-4d19-867d-6707665f1cc5" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-eb634f04-58e9-4d19-867d-6707665f1cc5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Deleting offline snapshot eb634f04-58e9-4d19-867d-6707665f1cc5 of volume 5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] snapshot_file for this snap is: volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0298cf38-02f8-4c48-8f5c-839358eefd3f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:00 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 Apr 14 03:06:00 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:00 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10ad7a99-74d1-4942-8108-b518459e0cd3 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461" returned: 0 in 0.501s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:00 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 is being set with open permissions: ugo+rw Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:00 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 Apr 14 03:06:00 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:00 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.441s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:00 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Deleted volume successfully. Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-34e18d63-6b72-4478-a473-425d32e62914 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-16277d2c-c49a-4721-b7c2-c2a98d170a09-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:00 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5" returned: 0 in 0.501s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd60058-98fd-4f8b-ab16-60db732d89da]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:00 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 Apr 14 03:06:00 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:00 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461" returned: 0 in 0.427s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:00 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.info Apr 14 03:06:00 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:01 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" returned: 0 in 0.455s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:01 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 Apr 14 03:06:01 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:01 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.info" returned: 0 in 0.416s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:01 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.info is being set with open permissions: ugo+rw Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:01 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.info Apr 14 03:06:01 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:01 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5" returned: 0 in 0.459s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:01 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5 Apr 14 03:06:01 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:01 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.info" returned: 0 in 0.451s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-2dbe324a-49b2-4ee2-a453-e88e1b18a527" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-2dbe324a-49b2-4ee2-a453-e88e1b18a527" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] snapshot: e9403835-036a-4ac2-9134-9c1f2b4e8461, volume: 2dbe324a-49b2-4ee2-a453-e88e1b18a527, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a889f58-14bc-4e39-af59-ccb5435a18ab]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:01 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 Apr 14 03:06:01 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:02 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389.eb634f04-58e9-4d19-867d-6707665f1cc5" returned: 0 in 0.421s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-eb634f04-58e9-4d19-867d-6707665f1cc5" released by "_delete_snapshot" :: held 1.887s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" released by "delete_snapshot" :: held 1.898s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Created reservations ['9557ee47-c5e7-4010-b0b7-a37440167800', 'dd22c9fb-299b-465c-83be-07cbbd2c46af', '74fb57cb-afe9-4990-a063-da65173656cd', 'b6587fe3-c3b6-4f44-bc71-28c308cedfed'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:02 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Delete snapshot completed successfully. Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b46a8519-6529-46ff-9bc4-4e63e65f367d tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-eb634f04-58e9-4d19-867d-6707665f1cc5-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:02 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10ad7a99-74d1-4942-8108-b518459e0cd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d2d5cd-3bf6-4728-b2ba-ed5c723023eb]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:02 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 Apr 14 03:06:02 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-5f6ccb14-a1ee-42a6-bc44-32c7f8456389-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-5f6ccb14-a1ee-42a6-bc44-32c7f8456389-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a45c43a-7f9b-4ff1-a271-65da4ae75fe3]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:02 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 Apr 14 03:06:02 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:02 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3" returned: 0 in 0.540s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:02 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 Apr 14 03:06:02 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:02 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:03 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389 Apr 14 03:06:03 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:04 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" returned: 0 in 1.029s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-5f6ccb14-a1ee-42a6-bc44-32c7f8456389" released by "delete_volume" :: held 1.555s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Created reservations ['753301da-e0a6-4558-81d9-7b6f29889b79', 'a26d6523-0e8b-4f29-8ca1-c8768b129d44', '545d6474-e3c0-4dd9-887f-8e4ba3c7a6d3', '1a8d454f-2636-4aab-b9fa-d67a7d9b74f5'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:04 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:04 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-06180b74-9d57-44f0-baba-63cc195c1fe9-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-06180b74-9d57-44f0-baba-63cc195c1fe9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:04 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "cinder-quobyte-06180b74-9d57-44f0-baba-63cc195c1fe9" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527" returned: 0 in 1.988s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-06180b74-9d57-44f0-baba-63cc195c1fe9" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7c1942-aeb1-422e-b4d6-34581f284afe]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc88fde7-aa00-4396-846a-c5f768a8aca5]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:04 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 Apr 14 03:06:04 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:04 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 Apr 14 03:06:04 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:05 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.690s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:05 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Deleted volume successfully. Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e97e8be9-e68e-4728-a167-f13d1832c267 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-5f6ccb14-a1ee-42a6-bc44-32c7f8456389-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:05 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9" returned: 0 in 0.475s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:05 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9 Apr 14 03:06:05 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:05 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3" returned: 0 in 0.600s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:06:05 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Converted 1024.00 MB image at 514.99 MB/s Apr 14 03:06:05 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 is being set with open permissions: ugo+rw Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:05 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 Apr 14 03:06:05 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:05 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-06180b74-9d57-44f0-baba-63cc195c1fe9" returned: 0 in 0.425s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-quobyte-06180b74-9d57-44f0-baba-63cc195c1fe9" released by "delete_volume" :: held 0.951s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Created reservations ['b3bc5b02-7d13-4768-b1e9-8fd8bc5210c0', 'c064e874-e960-4105-ac6f-2e4384edc77d', '161cd71f-0d1a-4380-9b2e-18cb70bd4601', '7ba6ab6c-30a5-4faf-bd33-8c490d25861e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:05 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:05 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:05 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527" returned: 0 in 0.445s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-2dbe324a-49b2-4ee2-a453-e88e1b18a527" released by "_copy_volume_from_snapshot" :: held 4.099s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-e9403835-036a-4ac2-9134-9c1f2b4e8461" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-e9403835-036a-4ac2-9134-9c1f2b4e8461" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Deleting offline snapshot e9403835-036a-4ac2-9134-9c1f2b4e8461 of volume 10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] snapshot_file for this snap is: volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea099ac-f19c-43f0-ac00-17aa2e083e12]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:06 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 Apr 14 03:06:06 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:06 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.436s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:06 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Deleted volume successfully. Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-073f3395-f68f-4252-a518-3d3c21304ea4 tempest-VolumesSnapshotTestJSON-188249116 None] Lock "cinder-06180b74-9d57-44f0-baba-63cc195c1fe9-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:06 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461" returned: 0 in 0.509s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10ad7a99-74d1-4942-8108-b518459e0cd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454df82-dc6b-4545-b6bc-58f3ce9468a3]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:06 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 Apr 14 03:06:06 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:06 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3" returned: 0 in 0.499s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:06 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 Apr 14 03:06:06 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:07 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461" returned: 0 in 0.470s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:07 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461 Apr 14 03:06:07 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:07 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3.e9403835-036a-4ac2-9134-9c1f2b4e8461" returned: 0 in 0.478s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-e9403835-036a-4ac2-9134-9c1f2b4e8461" released by "_delete_snapshot" :: held 2.004s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.022s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.737s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652915403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ca4de9-8b3a-49e1-8c94-fbd29cfb524f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:05:56Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Creating volume 03ca4de9-8b3a-49e1-8c94-fbd29cfb524f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:07 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8272c402-712c-4ca4-bf43-f3dd41301767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527', 'volume_size': 1, 'source_volid': '10ad7a99-74d1-4942-8108-b518459e0cd3', 'source_volstatus': 'available'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4aec93-bd62-41c3-b5d4-4eb59d31482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:07 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f 1073741824 Apr 14 03:06:07 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:07 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Volume volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 (2dbe324a-49b2-4ee2-a453-e88e1b18a527): created successfully Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4aec93-bd62-41c3-b5d4-4eb59d31482b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:07 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (c8e28f3a-e91e-4fb1-a62a-8067704bb712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:08 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-de4a45db-f723-4d11-afcb-60fb0eac21f0 tempest-VolumesGetTest-1479952312 None] Created volume successfully. Apr 14 03:06:08 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f 1073741824" returned: 0 in 0.572s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:08 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f Apr 14 03:06:08 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (c91fdcdc-189f-45d3-9804-af26a69ceec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547bc32d-3f79-42f0-9119-9d9d7910632c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547bc32d-3f79-42f0-9119-9d9d7910632c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1682991497',display_name='tempest-VolumesGetTest-Volume-2114663288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca89f70-05f9-466d-bf17-aab25bad1c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:09Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33de1964-54b4-4415-8da5-e43484cdd8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33de1964-54b4-4415-8da5-e43484cdd8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5733b7a2-12de-42d7-af90-fe64d1870f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5733b7a2-12de-42d7-af90-fe64d1870f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca89f70-05f9-466d-bf17-aab25bad1c6f', 'volume_name': 'volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a664998-24f6-4d98-a4d9-96fda6586f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a664998-24f6-4d98-a4d9-96fda6586f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692ae814-6549-4366-a4b9-e70290e59258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:08 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Volume 5ca89f70-05f9-466d-bf17-aab25bad1c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f', 'volume_size': 1} Apr 14 03:06:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:09 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f" returned: 0 in 0.447s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1682991497',display_name='tempest-VolumesGetTest-Volume-2114663288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca89f70-05f9-466d-bf17-aab25bad1c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:09Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Creating volume 5ca89f70-05f9-466d-bf17-aab25bad1c6f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:09 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29d2d3f-7977-45c2-9cfb-64568f5fb892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d41afe-edaa-4cda-a680-cb0d01c432eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:09 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f 1073741824 Apr 14 03:06:09 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:09 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f (03ca4de9-8b3a-49e1-8c94-fbd29cfb524f): created successfully Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d41afe-edaa-4cda-a680-cb0d01c432eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (f2e29e67-be95-44f5-9e89-cff44a0b33ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:09 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-aecc7e32-63ec-4a17-9f02-3d0bf7f22554 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created volume successfully. Apr 14 03:06:09 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f 1073741824" returned: 0 in 0.526s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:09 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f Apr 14 03:06:09 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (05c03e7e-2919-435b-af94-f99ffd441c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb9dace-566d-447d-8b42-40757e1224a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb9dace-566d-447d-8b42-40757e1224a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-741772989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd56062-a1bc-4fd6-8aa8-919c881bd28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:10Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce8e149-6816-4aeb-9040-0111c5c3cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce8e149-6816-4aeb-9040-0111c5c3cd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ff7ed7-6d40-46ea-9633-67a701b504ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ff7ed7-6d40-46ea-9633-67a701b504ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd56062-a1bc-4fd6-8aa8-919c881bd28c', 'volume_name': 'volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6084dbcc-2ddc-465c-851a-d75dd9897e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6084dbcc-2ddc-465c-851a-d75dd9897e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1403f36c-68f6-4ed6-942c-1ad59816a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:09 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume 1dd56062-a1bc-4fd6-8aa8-919c881bd28c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c', 'volume_size': 1} Apr 14 03:06:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:10 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f" returned: 0 in 0.455s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.162s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-741772989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd56062-a1bc-4fd6-8aa8-919c881bd28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:10Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Creating volume 1dd56062-a1bc-4fd6-8aa8-919c881bd28c {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:10 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692ae814-6549-4366-a4b9-e70290e59258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c 1073741824 Apr 14 03:06:10 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1823ead-6592-4eff-9bd3-e06f42855cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Volume volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f (5ca89f70-05f9-466d-bf17-aab25bad1c6f): created successfully Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1823ead-6592-4eff-9bd3-e06f42855cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (c91fdcdc-189f-45d3-9804-af26a69ceec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:10 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b3e087a8-feee-4b21-84bc-f9a735df3997 tempest-VolumesGetTest-1479952312 None] Created volume successfully. Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (4b5fa4a4-a584-486a-bbe5-77905b3a859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afda529-fafa-4c80-a8a2-0d9ba3304b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afda529-fafa-4c80-a8a2-0d9ba3304b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1930087438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef940b8-b262-4034-bbf0-e3062820668f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:10Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f77fd1-4c91-4b06-8715-0dfd8425b362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f77fd1-4c91-4b06-8715-0dfd8425b362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c1ecb6-b0cc-4e7c-bbc0-772db9fc5824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c1ecb6-b0cc-4e7c-bbc0-772db9fc5824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef940b8-b262-4034-bbf0-e3062820668f', 'volume_name': 'volume-0ef940b8-b262-4034-bbf0-e3062820668f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466c343b-48c6-48b2-8081-4dba71b52b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466c343b-48c6-48b2-8081-4dba71b52b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba53ec5-bdbc-4a3f-a300-19cd2d924c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume 0ef940b8-b262-4034-bbf0-e3062820668f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef940b8-b262-4034-bbf0-e3062820668f', 'volume_size': 1} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (b9679432-5162-4bc5-9e96-9305ca06c674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49781c59-3097-4e95-a665-3bd105af727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49781c59-3097-4e95-a665-3bd105af727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1546931357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918e8bba-2de1-4c04-91c6-7de09c6cb11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:10Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7439362a-b909-4ac7-805d-ec8759c71c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7439362a-b909-4ac7-805d-ec8759c71c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf46e14-1bf4-424c-bae3-ce70c297726f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf46e14-1bf4-424c-bae3-ce70c297726f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918e8bba-2de1-4c04-91c6-7de09c6cb11b', 'volume_name': 'volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763b7808-9f3a-4e36-82eb-d361edcec93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763b7808-9f3a-4e36-82eb-d361edcec93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df72c85-1499-4dce-8d9d-f7c3a2abf2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume 918e8bba-2de1-4c04-91c6-7de09c6cb11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b', 'volume_size': 1} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (29a7730e-a164-46d5-ac3f-4a89772460ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bfbd50-8304-43d7-a076-82e37937f129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bfbd50-8304-43d7-a076-82e37937f129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053339824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065b0272-a20b-4b37-8d89-0abb765390bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:11Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63966d5-1465-4849-928f-a0f95deb6b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63966d5-1465-4849-928f-a0f95deb6b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca45715-3775-45fe-bd89-90b594686f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca45715-3775-45fe-bd89-90b594686f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065b0272-a20b-4b37-8d89-0abb765390bd', 'volume_name': 'volume-065b0272-a20b-4b37-8d89-0abb765390bd', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a32c50e-b106-4b18-80ac-0cdba58686f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a32c50e-b106-4b18-80ac-0cdba58686f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83c7263-a697-43d9-aa31-f38df2c8c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume 065b0272-a20b-4b37-8d89-0abb765390bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065b0272-a20b-4b37-8d89-0abb765390bd', 'volume_size': 1} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c 1073741824" returned: 0 in 0.586s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:10 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c Apr 14 03:06:10 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (a9cc5efc-cba7-4e83-a8d8-9295d62e354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a84be1-3d36-4049-89e0-e809277f8510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a84be1-3d36-4049-89e0-e809277f8510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000281898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd1a949-5f45-4489-b048-ebccd86ad98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:11Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c89d62-820c-4b20-a8e6-14455ae2b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c89d62-820c-4b20-a8e6-14455ae2b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b89726d-3f77-4d2c-827e-beccd056b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b89726d-3f77-4d2c-827e-beccd056b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd1a949-5f45-4489-b048-ebccd86ad98f', 'volume_name': 'volume-3dd1a949-5f45-4489-b048-ebccd86ad98f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3542bf-ed85-431a-a199-67ddd032edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3542bf-ed85-431a-a199-67ddd032edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cd6671-a7a9-42e2-b08d-a89e792a98c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:10 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume 3dd1a949-5f45-4489-b048-ebccd86ad98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd1a949-5f45-4489-b048-ebccd86ad98f', 'volume_size': 1} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-5ca89f70-05f9-466d-bf17-aab25bad1c6f-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Lock "cinder-5ca89f70-05f9-466d-bf17-aab25bad1c6f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-5ca89f70-05f9-466d-bf17-aab25bad1c6f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-5ca89f70-05f9-466d-bf17-aab25bad1c6f" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e32ff5-9781-4a10-94d5-363a05726eca]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:10 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f Apr 14 03:06:10 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:10 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (86d51023-c7fb-4835-824e-dc99525f4c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afdfd9f-767a-44ee-bf0d-0cdbb12b9757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afdfd9f-767a-44ee-bf0d-0cdbb12b9757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1466756376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cb03bc-3623-42a0-9cac-95636b4aadc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:11Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0de1460-8957-4e16-adf3-b5741e8ae1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0de1460-8957-4e16-adf3-b5741e8ae1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96705e5b-ab5a-4cdb-bb8f-391622162cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96705e5b-ab5a-4cdb-bb8f-391622162cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cb03bc-3623-42a0-9cac-95636b4aadc5', 'volume_name': 'volume-62cb03bc-3623-42a0-9cac-95636b4aadc5', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9495d2df-f161-4ab1-8766-ed866c1e9593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9495d2df-f161-4ab1-8766-ed866c1e9593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26ba920-5709-438b-b8d1-4f80fa502472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:11 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume 62cb03bc-3623-42a0-9cac-95636b4aadc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cb03bc-3623-42a0-9cac-95636b4aadc5', 'volume_size': 1} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:11 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1930087438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef940b8-b262-4034-bbf0-e3062820668f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:10Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Creating volume 0ef940b8-b262-4034-bbf0-e3062820668f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:11 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1403f36c-68f6-4ed6-942c-1ad59816a05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6844ce3-1617-4cd9-ab9c-1194d142455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:11 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f 1073741824 Apr 14 03:06:11 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:11 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c (1dd56062-a1bc-4fd6-8aa8-919c881bd28c): created successfully Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6844ce3-1617-4cd9-ab9c-1194d142455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (05c03e7e-2919-435b-af94-f99ffd441c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:11 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-2c2d53e0-118f-4fef-89e5-449ad4cca023 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created volume successfully. Apr 14 03:06:11 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f" returned: 0 in 0.500s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:11 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f Apr 14 03:06:11 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:11 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f 1073741824" returned: 0 in 0.535s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:11 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f Apr 14 03:06:11 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:11 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-5ca89f70-05f9-466d-bf17-aab25bad1c6f" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-5ca89f70-05f9-466d-bf17-aab25bad1c6f" released by "delete_volume" :: held 0.957s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Created reservations ['3039bad6-c890-400a-85ad-08e96502a924', 'f908b506-d4d8-48e0-a038-b9e520cea0dc', 'e02ae4f4-29ae-41b3-a5aa-ea4b05ae9d70', '1ae75ae4-62b7-4db0-930a-28a9bd3b7401'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:11 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:11 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-2dbe324a-49b2-4ee2-a453-e88e1b18a527-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Lock "cinder-2dbe324a-49b2-4ee2-a453-e88e1b18a527-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-2dbe324a-49b2-4ee2-a453-e88e1b18a527" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-2dbe324a-49b2-4ee2-a453-e88e1b18a527" acquired by "delete_volume" :: waited 0.020s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c056b9-3663-4f74-8391-29653bb43606]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:12 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1546931357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918e8bba-2de1-4c04-91c6-7de09c6cb11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:10Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Creating volume 918e8bba-2de1-4c04-91c6-7de09c6cb11b {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:12 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:12 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 Apr 14 03:06:12 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba53ec5-bdbc-4a3f-a300-19cd2d924c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef940b8-b262-4034-bbf0-e3062820668f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcd7cdb-4b6b-4406-bba9-57d9f4f7677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:12 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b 1073741824 Apr 14 03:06:12 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:12 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume volume-0ef940b8-b262-4034-bbf0-e3062820668f (0ef940b8-b262-4034-bbf0-e3062820668f): created successfully Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcd7cdb-4b6b-4406-bba9-57d9f4f7677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (4b5fa4a4-a584-486a-bbe5-77905b3a859f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:12 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-301132f1-5be1-446d-abe0-b4052cd58689 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created volume successfully. Apr 14 03:06:12 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.498s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:12 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Deleted volume successfully. Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f522efd4-b796-4bc9-a1b5-65c1cb7918c3 tempest-VolumesGetTest-1479952312 None] Lock "cinder-5ca89f70-05f9-466d-bf17-aab25bad1c6f-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:12 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:12 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527 Apr 14 03:06:12 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:12 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b 1073741824" returned: 0 in 0.534s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:12 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b Apr 14 03:06:12 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:13 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2dbe324a-49b2-4ee2-a453-e88e1b18a527" returned: 0 in 0.401s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-2dbe324a-49b2-4ee2-a453-e88e1b18a527" released by "delete_volume" :: held 0.902s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Created reservations ['3c4a6349-2f8a-44dc-bb77-4ac1a419db74', '90b11b36-70ac-44d9-a36d-33e9f34192ee', '78edbbe0-e47d-48a8-b649-d8ca06a72b17', '6c9f4d54-d259-49c4-ae47-babef075cb39'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:13 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:13 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:13 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.612s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053339824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065b0272-a20b-4b37-8d89-0abb765390bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:11Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Creating volume 065b0272-a20b-4b37-8d89-0abb765390bd {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:13 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df72c85-1499-4dce-8d9d-f7c3a2abf2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:13 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd 1073741824 Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b556ce-5d81-4abd-93a2-432ecd4a6e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:13 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-10ad7a99-74d1-4942-8108-b518459e0cd3-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:13 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b (918e8bba-2de1-4c04-91c6-7de09c6cb11b): created successfully Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b556ce-5d81-4abd-93a2-432ecd4a6e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (b9679432-5162-4bc5-9e96-9305ca06c674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:13 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-bd3a658f-d3bd-4225-bcb1-9411d59aa864 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created volume successfully. Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Lock "cinder-10ad7a99-74d1-4942-8108-b518459e0cd3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-10ad7a99-74d1-4942-8108-b518459e0cd3" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-10ad7a99-74d1-4942-8108-b518459e0cd3" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a90bbc-8fa9-4596-82c5-859286de12eb]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:13 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 Apr 14 03:06:13 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:13 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.448s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:13 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Deleted volume successfully. Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4e0e429-ed1e-4311-97e5-7f9bf520e62b tempest-VolumesGetTest-1479952312 None] Lock "cinder-2dbe324a-49b2-4ee2-a453-e88e1b18a527-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:13 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd 1073741824" returned: 0 in 0.459s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:13 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd Apr 14 03:06:13 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:13 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3" returned: 0 in 0.490s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:13 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3 Apr 14 03:06:13 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:14 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd" returned: 0 in 0.397s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.281s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000281898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd1a949-5f45-4489-b048-ebccd86ad98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:11Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Creating volume 3dd1a949-5f45-4489-b048-ebccd86ad98f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:14 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d83c7263-a697-43d9-aa31-f38df2c8c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065b0272-a20b-4b37-8d89-0abb765390bd', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afd7f1c-967b-4489-9332-72be7c9892d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:14 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f 1073741824 Apr 14 03:06:14 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:14 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume volume-065b0272-a20b-4b37-8d89-0abb765390bd (065b0272-a20b-4b37-8d89-0abb765390bd): created successfully Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afd7f1c-967b-4489-9332-72be7c9892d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (29a7730e-a164-46d5-ac3f-4a89772460ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:14 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8064364e-f091-4e97-af02-a5bb13ab0f4b tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created volume successfully. Apr 14 03:06:14 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-10ad7a99-74d1-4942-8108-b518459e0cd3" returned: 0 in 0.434s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-10ad7a99-74d1-4942-8108-b518459e0cd3" released by "delete_volume" :: held 0.962s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Created reservations ['0454b96f-ae55-498f-b7bc-67efdfe0c141', '4169a733-6cca-4728-9c9c-5e4e2327c7a2', 'e87fc08c-5348-4d11-927b-1e3798c9a7ec', '915cb735-816f-4cf3-a8d1-3d884c68ccf8'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:14 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:14 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:14 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f 1073741824" returned: 0 in 0.515s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:14 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f Apr 14 03:06:14 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:14 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.397s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:14 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Deleted volume successfully. Apr 14 03:06:14 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:14 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c67b00a8-9efe-4c60-b723-f8d76203129f tempest-VolumesGetTest-1479952312 None] Lock "cinder-10ad7a99-74d1-4942-8108-b518459e0cd3-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:15 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f" returned: 0 in 0.420s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.029s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1466756376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cb03bc-3623-42a0-9cac-95636b4aadc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c397861b83447dfb92c063ae5efa61d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:11Z,use_quota=True,user_id='754e72d874b94cc5b56955b5380eaa78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Creating volume 62cb03bc-3623-42a0-9cac-95636b4aadc5 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:15 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67cd6671-a7a9-42e2-b08d-a89e792a98c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd1a949-5f45-4489-b048-ebccd86ad98f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2567904-7c4f-4cb0-9ca1-d39c8c4192bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:15 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 1073741824 Apr 14 03:06:15 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:15 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume volume-3dd1a949-5f45-4489-b048-ebccd86ad98f (3dd1a949-5f45-4489-b048-ebccd86ad98f): created successfully Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2567904-7c4f-4cb0-9ca1-d39c8c4192bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (a9cc5efc-cba7-4e83-a8d8-9295d62e354f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:15 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-23a7497c-3ed9-4792-9734-0c39bb2ba064 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created volume successfully. Apr 14 03:06:15 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.402s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:15 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 1073741824" returned: 0 in 0.550s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:DELETE=25,cinder:SELECT=181,cinder:INSERT=55,cinder:UPDATE=238 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:15 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 Apr 14 03:06:15 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (010d7e47-c591-4b61-8e02-53eb0b601b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f644cd25-90d5-46c7-a5b8-8e4e83577264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f644cd25-90d5-46c7-a5b8-8e4e83577264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2070701513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05eba476-a692-4ce7-a9bf-3c5cf0166693,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:16Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f435a975-b461-4ef2-b73c-55351857f60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f435a975-b461-4ef2-b73c-55351857f60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c047e1-8417-4279-bbf9-4087185a4a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:15 devstack cinder-volume[82473]: DEBUG cinder.image.glance [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Creating Keystone auth plugin from conf {{(pid=82473) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c047e1-8417-4279-bbf9-4087185a4a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05eba476-a692-4ce7-a9bf-3c5cf0166693', 'volume_name': 'volume-05eba476-a692-4ce7-a9bf-3c5cf0166693', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086eb310-711e-4e02-a71c-2b6c1ca3218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086eb310-711e-4e02-a71c-2b6c1ca3218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06522c58-e0f9-4a44-993c-7acd7f9c553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:16 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Volume 05eba476-a692-4ce7-a9bf-3c5cf0166693: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05eba476-a692-4ce7-a9bf-3c5cf0166693', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Trying to clone 05eba476-a692-4ce7-a9bf-3c5cf0166693 from image 9179ce72-7062-46a0-b714-df74aac4cc2c at location (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]). {{(pid=82473) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 14 03:06:16 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5" returned: 0 in 0.473s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.028s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Creating offline snapshot 308a5cc2-d1be-4977-ae1f-23b865f2f585 of volume 1dd56062-a1bc-4fd6-8aa8-919c881bd28c {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26ba920-5709-438b-b8d1-4f80fa502472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cb03bc-3623-42a0-9cac-95636b4aadc5', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2ad245-3381-471d-bbba-28cd3a2c9e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8db54ff-6834-455e-aaba-81716ddd763c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:16 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Volume volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 (62cb03bc-3623-42a0-9cac-95636b4aadc5): created successfully Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2ad245-3381-471d-bbba-28cd3a2c9e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Flow 'volume_create_manager' (86d51023-c7fb-4835-824e-dc99525f4c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:16 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ecc85d29-db14-40d8-87d8-ef0d241b34a5 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created volume successfully. Apr 14 03:06:16 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c Apr 14 03:06:16 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 14 03:06:16 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Image download 20.69 MB at 20.69 MB/s Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffc0996-b086-46db-893a-c0657a9e4411]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:16 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD Apr 14 03:06:16 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-62cb03bc-3623-42a0-9cac-95636b4aadc5-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-62cb03bc-3623-42a0-9cac-95636b4aadc5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-quobyte-62cb03bc-3623-42a0-9cac-95636b4aadc5" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-62cb03bc-3623-42a0-9cac-95636b4aadc5" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6ccc4b-1e31-4283-be8c-7b2bad178a81]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:16 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 Apr 14 03:06:16 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:16 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" returned: 0 in 0.554s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:16 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 1G Apr 14 03:06:16 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:16 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Temporary image 9179ce72-7062-46a0-b714-df74aac4cc2c is fetched for user e794c01153084766aa539d17585ba677. {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82ee3c-adc5-4c48-880b-3b503090c06e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:16 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD Apr 14 03:06:16 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:17 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5" returned: 0 in 0.506s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:17 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5 Apr 14 03:06:17 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:17 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 1G" returned: 0 in 0.523s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:17 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 Apr 14 03:06:17 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:17 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:17 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-62cb03bc-3623-42a0-9cac-95636b4aadc5" returned: 0 in 0.424s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-62cb03bc-3623-42a0-9cac-95636b4aadc5" released by "delete_volume" :: held 0.959s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created reservations ['3e871caf-fd9a-4fba-8d71-3b181493f73d', '48618bdc-e8ac-47ae-83fb-f68d194d8565', '98c80cdd-637d-4242-a965-b5613e60a11f', 'dca16dc5-cb5e-45c4-8f77-3db8ff8b5724'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:17 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:17 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-3dd1a949-5f45-4489-b048-ebccd86ad98f-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-3dd1a949-5f45-4489-b048-ebccd86ad98f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-quobyte-3dd1a949-5f45-4489-b048-ebccd86ad98f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-3dd1a949-5f45-4489-b048-ebccd86ad98f" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:17 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585" returned: 0 in 0.504s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:17 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 is being set with open permissions: ugo+rw Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733d163-f003-4fca-a9aa-c3ee7dba65e2]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:17 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:17 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 Apr 14 03:06:17 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:17 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f Apr 14 03:06:17 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:18 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.457s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:18 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Deleted volume successfully. Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a9c5d52-9dd4-4cfe-99f2-5a22ec3af030 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-62cb03bc-3623-42a0-9cac-95636b4aadc5-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:18 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585" returned: 0 in 0.429s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:18 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.info Apr 14 03:06:18 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:18 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:18 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f Apr 14 03:06:18 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:18 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.info" returned: 0 in 0.423s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:18 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.info is being set with open permissions: ugo+rw Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:18 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.info Apr 14 03:06:18 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:18 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3dd1a949-5f45-4489-b048-ebccd86ad98f" returned: 0 in 0.411s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-3dd1a949-5f45-4489-b048-ebccd86ad98f" released by "delete_volume" :: held 0.931s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created reservations ['f828980f-8c64-480d-a19b-7030e4461958', '27895506-b83b-4313-9601-19bcfc0a35e6', 'ed8977f9-b58f-4766-bbee-5a971ad4364b', '6f1566ce-f1ee-4f7c-9809-902cdf49f02c'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:18 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:18 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-065b0272-a20b-4b37-8d89-0abb765390bd-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-065b0272-a20b-4b37-8d89-0abb765390bd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-quobyte-065b0272-a20b-4b37-8d89-0abb765390bd" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-065b0272-a20b-4b37-8d89-0abb765390bd" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac22ce1-8bc3-48ba-9522-dd9dae56dfcb]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:18 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd Apr 14 03:06:18 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:19 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.info" returned: 0 in 0.455s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2070701513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05eba476-a692-4ce7-a9bf-3c5cf0166693,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:16Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Creating volume 05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:19 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:19 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 1073741824 Apr 14 03:06:19 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:19 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a4e80ecc-4128-4964-8523-e18102559655 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Create snapshot completed successfully Apr 14 03:06:19 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.460s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:19 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Deleted volume successfully. Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e37b98c9-f0e2-47e0-bc4e-b4b534f9c586 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-3dd1a949-5f45-4489-b048-ebccd86ad98f-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:19 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd" returned: 0 in 0.490s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:19 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd Apr 14 03:06:19 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (7aac98c9-4711-41c5-b2df-1d9deb08f563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e519e4b9-9981-4d4f-bc8f-ca01e6ccb3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:UPDATE=237,cinder:SELECT=200,cinder:INSERT=66,cinder:DELETE=20 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e519e4b9-9981-4d4f-bc8f-ca01e6ccb3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144909197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cd1a39-e5a4-42ee-bd21-95009c194c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb67d9c-b7ad-4202-9e40-29d7aa688a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb67d9c-b7ad-4202-9e40-29d7aa688a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b01484-828f-4bc5-88e2-5af54d7d9271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b01484-828f-4bc5-88e2-5af54d7d9271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cd1a39-e5a4-42ee-bd21-95009c194c60', 'volume_name': 'volume-20cd1a39-e5a4-42ee-bd21-95009c194c60', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b317675a-eae7-4504-8c52-42bba53d59c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b317675a-eae7-4504-8c52-42bba53d59c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b8f9f8-4d7c-4f36-9a2d-10d6d5d5b392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume 20cd1a39-e5a4-42ee-bd21-95009c194c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cd1a39-e5a4-42ee-bd21-95009c194c60', 'volume_size': 1} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 1073741824" returned: 0 in 0.546s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:19 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 Apr 14 03:06:19 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (952fb103-6983-4a33-9181-780d3d5f6722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a604dc5-eb56-4b65-8d33-c2c71930ec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a604dc5-eb56-4b65-8d33-c2c71930ec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397249788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7394a9d-51aa-4f84-be46-2453d3feaa19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cc9a4b-d1f8-4a34-ad17-8e9b7b3ae431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cc9a4b-d1f8-4a34-ad17-8e9b7b3ae431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b0edc2-377b-48e4-b5e1-5d8d99cd1f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b0edc2-377b-48e4-b5e1-5d8d99cd1f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7394a9d-51aa-4f84-be46-2453d3feaa19', 'volume_name': 'volume-b7394a9d-51aa-4f84-be46-2453d3feaa19', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babcf764-4a9a-463f-8ca6-789a63d4b1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (babcf764-4a9a-463f-8ca6-789a63d4b1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8ac9cc-a4ef-4d50-9ae6-c30b33a28fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume b7394a9d-51aa-4f84-be46-2453d3feaa19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7394a9d-51aa-4f84-be46-2453d3feaa19', 'volume_size': 1} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:19 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-065b0272-a20b-4b37-8d89-0abb765390bd" returned: 0 in 0.517s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-065b0272-a20b-4b37-8d89-0abb765390bd" released by "delete_volume" :: held 1.030s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created reservations ['80959355-5ba8-40ae-be96-679ecadb79d9', 'c03175f9-37fd-43d2-b9f8-0d1e4e3eebbe', 'b97c847b-437d-4244-818e-2f55189f763a', '56a17b23-62a9-4fad-b11a-e1c2a63060f8'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (6dc46067-c32a-402e-8046-ad39bfedb40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec1bafd-a9b7-417a-9424-67ac1dba269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec1bafd-a9b7-417a-9424-67ac1dba269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-995283843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3136e17e-2317-473e-8229-c575df705d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26d8781-0c4f-4512-a61e-f07e5e218acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26d8781-0c4f-4512-a61e-f07e5e218acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1224c74-a6da-4910-9604-7eeda8ee116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1224c74-a6da-4910-9604-7eeda8ee116b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3136e17e-2317-473e-8229-c575df705d44', 'volume_name': 'volume-3136e17e-2317-473e-8229-c575df705d44', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bdccc4-bc58-4bbb-9a5a-382b8b8836bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bdccc4-bc58-4bbb-9a5a-382b8b8836bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e85bde6-8be8-471e-8c0c-2ee85152fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume 3136e17e-2317-473e-8229-c575df705d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3136e17e-2317-473e-8229-c575df705d44', 'volume_size': 1} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:20 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:20 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (52dd7896-dabe-4c6f-bd71-8bf91ad1aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e685fa85-ebcc-475d-a440-345dac4dea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e685fa85-ebcc-475d-a440-345dac4dea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928763372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65aec149-18ee-422d-8760-f96546c0d85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2273d3a-2439-45cf-924e-18cd921a49f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2273d3a-2439-45cf-924e-18cd921a49f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6e3fcc-80db-448c-890a-c3db98f52f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6e3fcc-80db-448c-890a-c3db98f52f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65aec149-18ee-422d-8760-f96546c0d85f', 'volume_name': 'volume-65aec149-18ee-422d-8760-f96546c0d85f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427b8601-64c9-4435-b3e0-2a6a6bcf68b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427b8601-64c9-4435-b3e0-2a6a6bcf68b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bac3f82-76ba-4e21-975d-409935d06441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume 65aec149-18ee-422d-8760-f96546c0d85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65aec149-18ee-422d-8760-f96546c0d85f', 'volume_size': 1} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:20 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693" returned: 0 in 0.566s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144909197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cd1a39-e5a4-42ee-bd21-95009c194c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Creating volume 20cd1a39-e5a4-42ee-bd21-95009c194c60 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:20 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Attempting download of 9179ce72-7062-46a0-b714-df74aac4cc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}])) to volume 05eba476-a692-4ce7-a9bf-3c5cf0166693. {{(pid=82473) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 14 03:06:20 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 1073741824 Apr 14 03:06:20 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3587dc-d3a3-466c-86bc-faa069e5da84]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_yi8yos_5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (5587d954-b5f1-4258-8892-3c15f179729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:20 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_yi8yos_5 Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d3b6c0-a51f-4f26-88a3-dd363b86a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d3b6c0-a51f-4f26-88a3-dd363b86a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883119430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1805ff8-d2f2-46c7-a8e0-a805961067c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d75b945-49e7-4779-9e9a-2200c99104a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d75b945-49e7-4779-9e9a-2200c99104a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54688c2-deca-4bb8-8cfd-718124fab684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54688c2-deca-4bb8-8cfd-718124fab684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1805ff8-d2f2-46c7-a8e0-a805961067c9', 'volume_name': 'volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35aff6e8-6b16-426e-8174-e4f1c46f87cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35aff6e8-6b16-426e-8174-e4f1c46f87cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28945f37-61b3-4e03-8bdb-7d051914c704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:20 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume c1805ff8-d2f2-46c7-a8e0-a805961067c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9', 'volume_size': 1} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:20 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.496s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:20 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Deleted volume successfully. Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1a9b7620-18d8-4c77-ac5f-0064bb7751c6 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-065b0272-a20b-4b37-8d89-0abb765390bd-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:20 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 1073741824" returned: 0 in 0.549s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:20 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_yi8yos_5" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_yi8yos_5 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:20 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 Apr 14 03:06:20 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:20 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_yi8yos_5 Apr 14 03:06:20 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-918e8bba-2de1-4c04-91c6-7de09c6cb11b-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-918e8bba-2de1-4c04-91c6-7de09c6cb11b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-quobyte-918e8bba-2de1-4c04-91c6-7de09c6cb11b" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-918e8bba-2de1-4c04-91c6-7de09c6cb11b" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[74470793-f431-4a8e-a390-3b86b29f347b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:21 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b Apr 14 03:06:21 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:21 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_yi8yos_5" returned: 1 in 0.473s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9179ce72-7062-46a0-b714-df74aac4cc2c_yi8yos_5' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa44e2a-2751-4835-a100-bbdf9cbac80f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:21 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60" returned: 0 in 0.464s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1397249788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7394a9d-51aa-4f84-be46-2453d3feaa19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Creating volume b7394a9d-51aa-4f84-be46-2453d3feaa19 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:21 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b8f9f8-4d7c-4f36-9a2d-10d6d5d5b392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cd1a39-e5a4-42ee-bd21-95009c194c60', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628c5ec2-5fc9-4876-b37a-8b527c47cd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:21 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 1073741824 Apr 14 03:06:21 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:21 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD Apr 14 03:06:21 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:21 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 (20cd1a39-e5a4-42ee-bd21-95009c194c60): created successfully Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628c5ec2-5fc9-4876-b37a-8b527c47cd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (7aac98c9-4711-41c5-b2df-1d9deb08f563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:21 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c094e0dd-0824-41fe-a480-65ca128b057e tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created volume successfully. Apr 14 03:06:21 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:21 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b Apr 14 03:06:21 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:21 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] 9179ce72-7062-46a0-b714-df74aac4cc2c was qcow2, converting to raw {{(pid=82473) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:21 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 Apr 14 03:06:21 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:21 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 1073741824" returned: 0 in 0.494s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:21 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 Apr 14 03:06:21 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:21 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-918e8bba-2de1-4c04-91c6-7de09c6cb11b" returned: 0 in 0.434s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:21 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-918e8bba-2de1-4c04-91c6-7de09c6cb11b" released by "delete_volume" :: held 0.936s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created reservations ['06a69dbc-382c-4277-b953-9d39dadd2e24', '69cc6c1e-abc2-46da-b967-76de9abb50fa', 'e488a13f-5fff-4cfe-8f8c-87035df5b78a', '56bcf1dc-04f8-4baf-bab1-0c016046dcd6'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:22 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:22 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-0ef940b8-b262-4034-bbf0-e3062820668f-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-0ef940b8-b262-4034-bbf0-e3062820668f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-quobyte-0ef940b8-b262-4034-bbf0-e3062820668f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-0ef940b8-b262-4034-bbf0-e3062820668f" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f808881d-773e-44ae-a1ed-f6c40d1703c0]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:22 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19" returned: 0 in 0.435s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.269s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-995283843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3136e17e-2317-473e-8229-c575df705d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Creating volume 3136e17e-2317-473e-8229-c575df705d44 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:22 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f Apr 14 03:06:22 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:22 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8ac9cc-a4ef-4d50-9ae6-c30b33a28fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7394a9d-51aa-4f84-be46-2453d3feaa19', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:22 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 1073741824 Apr 14 03:06:22 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3512de-4ac6-4019-8130-371a282220fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:22 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 (b7394a9d-51aa-4f84-be46-2453d3feaa19): created successfully Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3512de-4ac6-4019-8130-371a282220fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (952fb103-6983-4a33-9181-780d3d5f6722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:22 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-2ee76f4a-8bdd-495f-95cf-ab0e99483237 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created volume successfully. Apr 14 03:06:22 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.604s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:22 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Deleted volume successfully. Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-eed6e361-f9ad-4aee-9f65-b25af99ff26f tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-918e8bba-2de1-4c04-91c6-7de09c6cb11b-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:22 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693" returned: 0 in 0.961s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9179ce72-7062-46a0-b714-df74aac4cc2c_vnqp1yfodevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:06:22 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Converted 112.00 MB image at 112.00 MB/s Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:22 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 1G Apr 14 03:06:22 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:22 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f" returned: 0 in 0.645s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:22 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f Apr 14 03:06:22 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:22 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 1073741824" returned: 0 in 0.601s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:22 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 Apr 14 03:06:22 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:23 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 1G" returned: 0 in 0.481s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dad0264-06c5-4b76-b47a-b7c775433824]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:23 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-0ef940b8-b262-4034-bbf0-e3062820668f" returned: 0 in 0.456s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-0ef940b8-b262-4034-bbf0-e3062820668f" released by "delete_volume" :: held 1.125s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:23 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 Apr 14 03:06:23 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created reservations ['0bf8618b-5d5c-4d48-ad5b-ea4025c403c6', 'e8f87962-afb2-45d2-9cb2-0af3a06eecf4', '7acb5660-56eb-415e-9d9e-247e68b95c90', '5568ca5d-5695-4f9d-b8a4-e1e553cba758'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:23 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.153s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928763372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65aec149-18ee-422d-8760-f96546c0d85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Creating volume 65aec149-18ee-422d-8760-f96546c0d85f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:23 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e85bde6-8be8-471e-8c0c-2ee85152fff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3136e17e-2317-473e-8229-c575df705d44', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:23 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f 1073741824 Apr 14 03:06:23 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f4cbaa-616e-4155-8368-a3fbb46a0822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:23 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume volume-3136e17e-2317-473e-8229-c575df705d44 (3136e17e-2317-473e-8229-c575df705d44): created successfully Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f4cbaa-616e-4155-8368-a3fbb46a0822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (6dc46067-c32a-402e-8046-ad39bfedb40e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8b849d97-0224-41b0-82a3-7e7ed8ee1a7f tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created volume successfully. Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:23 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:23 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:23 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693" returned: 0 in 0.485s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:23 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 Apr 14 03:06:23 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:23 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.414s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:23 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Deleted volume successfully. Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-107d2cce-d128-4709-8429-0c66cc81f3f0 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-0ef940b8-b262-4034-bbf0-e3062820668f-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:23 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f 1073741824" returned: 0 in 0.521s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:23 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f Apr 14 03:06:23 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:24 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693" returned: 1 in 0.491s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Downloaded image 9179ce72-7062-46a0-b714-df74aac4cc2c ((None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}])) to volume 05eba476-a692-4ce7-a9bf-3c5cf0166693 successfully. {{(pid=82473) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Temporary image 9179ce72-7062-46a0-b714-df74aac4cc2c for user e794c01153084766aa539d17585ba677 is deleted. {{(pid=82473) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.volume_utils [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Marking volume 05eba476-a692-4ce7-a9bf-3c5cf0166693 as bootable. {{(pid=82473) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Copying metadata from image 9179ce72-7062-46a0-b714-df74aac4cc2c to 05eba476-a692-4ce7-a9bf-3c5cf0166693. {{(pid=82473) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Creating volume glance metadata for volume 05eba476-a692-4ce7-a9bf-3c5cf0166693 backed by image 9179ce72-7062-46a0-b714-df74aac4cc2c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82473) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06522c58-e0f9-4a44-993c-7acd7f9c553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05eba476-a692-4ce7-a9bf-3c5cf0166693', 'volume_size': 1, 'image_id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9179ce72-7062-46a0-b714-df74aac4cc2c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7f984896781495abfa13c7fc6504361', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9179ce72-7062-46a0-b714-df74aac4cc2c', 'created_at': datetime.datetime(2026, 4, 14, 0, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 0, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9179ce72-7062-46a0-b714-df74aac4cc2c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40526a0-135f-40a7-859b-69cdd1100ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:24 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Volume volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 (05eba476-a692-4ce7-a9bf-3c5cf0166693): created successfully Apr 14 03:06:24 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40526a0-135f-40a7-859b-69cdd1100ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (010d7e47-c591-4b61-8e02-53eb0b601b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f" returned: 0 in 0.432s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.898s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883119430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1805ff8-d2f2-46c7-a8e0-a805961067c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef909aeb9c94f4791da86bcc23c9a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:20Z,use_quota=True,user_id='d5e36349f9094ce8bf969adeb677bbe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Creating volume c1805ff8-d2f2-46c7-a8e0-a805961067c9 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:24 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bac3f82-76ba-4e21-975d-409935d06441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65aec149-18ee-422d-8760-f96546c0d85f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce93a9fd-d281-45f4-b4ee-09e90531a7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:24 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 1073741824 Apr 14 03:06:24 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ff78d728-dd90-4d59-8e7e-84475e78ac57 tempest-VolumesGetTest-1479952312 None] Created volume successfully. Apr 14 03:06:24 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume volume-65aec149-18ee-422d-8760-f96546c0d85f (65aec149-18ee-422d-8760-f96546c0d85f): created successfully Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce93a9fd-d281-45f4-b4ee-09e90531a7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (52dd7896-dabe-4c6f-bd71-8bf91ad1aa71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-98d91be0-f160-40db-8917-74f4e321d612 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created volume successfully. Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "cinder-quobyte-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fb9e74-e405-4f11-8652-4d1565d49d89]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:24 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f Apr 14 03:06:24 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:24 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 1073741824" returned: 0 in 0.520s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:24 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 Apr 14 03:06:24 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:24 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f" returned: 0 in 0.504s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:24 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f Apr 14 03:06:24 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:25 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9" returned: 0 in 0.397s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28945f37-61b3-4e03-8bdb-7d051914c704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4260b18-9cab-411a-91cd-72db099cc30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:25 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Volume volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 (c1805ff8-d2f2-46c7-a8e0-a805961067c9): created successfully Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4260b18-9cab-411a-91cd-72db099cc30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Flow 'volume_create_manager' (5587d954-b5f1-4258-8892-3c15f179729a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:25 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-548c3220-86ba-4581-84a9-00769b03acdc tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created volume successfully. Apr 14 03:06:25 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f" returned: 0 in 0.441s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-quobyte-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f" released by "delete_volume" :: held 0.973s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Created reservations ['5e890fdc-785c-4485-918f-80134678699f', '9b87fd5d-7ec6-4834-bc8f-e0fcd18785b2', 'c208f75f-f196-4339-b6b4-0c48d2145c63', '9f50c151-b147-44f0-b74c-d360a72a7f40'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:25 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:25 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (8aca71af-ebfd-4dc1-a330-56d800c49324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adf00cb-2cdb-41d4-a2dd-1ff1824bc153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adf00cb-2cdb-41d4-a2dd-1ff1824bc153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-674887247',display_name='tempest-VolumesGetTest-Volume-994456563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3deb99f8-1595-444b-a575-dae84a520f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:26Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc928856-f24c-41e4-9174-644a0bbb6f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc928856-f24c-41e4-9174-644a0bbb6f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913ff6e5-6b32-471b-9ba0-277df1e1cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913ff6e5-6b32-471b-9ba0-277df1e1cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3deb99f8-1595-444b-a575-dae84a520f1a', 'volume_name': 'volume-3deb99f8-1595-444b-a575-dae84a520f1a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d2e3ce-d178-49e8-a822-2c119003e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d2e3ce-d178-49e8-a822-2c119003e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a5cbfe-b596-4f54-877c-ae58f7614d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:25 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Volume 3deb99f8-1595-444b-a575-dae84a520f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3deb99f8-1595-444b-a575-dae84a520f1a', 'volume_size': 1} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-674887247',display_name='tempest-VolumesGetTest-Volume-994456563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3deb99f8-1595-444b-a575-dae84a520f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672eb0c1826e4fe78a2a9444c672f905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:26Z,use_quota=True,user_id='e794c01153084766aa539d17585ba677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Creating volume 3deb99f8-1595-444b-a575-dae84a520f1a {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:25 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:25 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a 1073741824 Apr 14 03:06:25 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:25 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-c1805ff8-d2f2-46c7-a8e0-a805961067c9-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.442s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-c1805ff8-d2f2-46c7-a8e0-a805961067c9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:25 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Deleted volume successfully. Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f59d047d-f884-4727-808e-55589d708197 tempest-CreateVolumesFromSourceVolumeTest-1042281151 None] Lock "cinder-03ca4de9-8b3a-49e1-8c94-fbd29cfb524f-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-quobyte-c1805ff8-d2f2-46c7-a8e0-a805961067c9" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-c1805ff8-d2f2-46c7-a8e0-a805961067c9" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b5a690-ea94-4747-829d-ec9e343e280f]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:26 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 Apr 14 03:06:26 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:26 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a 1073741824" returned: 0 in 0.499s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:26 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a Apr 14 03:06:26 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:26 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:26 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9 Apr 14 03:06:26 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:26 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a" returned: 0 in 0.446s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a5cbfe-b596-4f54-877c-ae58f7614d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3deb99f8-1595-444b-a575-dae84a520f1a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220cbc5f-97c3-4402-838a-dbcbc275c32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:26 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Volume volume-3deb99f8-1595-444b-a575-dae84a520f1a (3deb99f8-1595-444b-a575-dae84a520f1a): created successfully Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220cbc5f-97c3-4402-838a-dbcbc275c32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Flow 'volume_create_manager' (8aca71af-ebfd-4dc1-a330-56d800c49324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:26 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-501fd0ab-d988-4538-bf20-90eb1278a942 tempest-VolumesGetTest-1479952312 None] Created volume successfully. Apr 14 03:06:26 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-c1805ff8-d2f2-46c7-a8e0-a805961067c9" returned: 0 in 0.454s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-c1805ff8-d2f2-46c7-a8e0-a805961067c9" released by "delete_volume" :: held 0.971s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:26 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created reservations ['04ec41bb-e975-4d5f-a749-efe75e451ed6', '88252b13-ceae-43fc-8c1d-834d2322596a', 'dea3fc69-5405-44b5-9c0e-5c0fb2ea816b', '94edd68f-2f1d-4447-9bd1-b9539cb03101'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:27 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:27 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:27 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.497s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Deleted volume successfully. Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-91dedd58-efe1-4c80-ab86-d97ace7d5463 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-c1805ff8-d2f2-46c7-a8e0-a805961067c9-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-3deb99f8-1595-444b-a575-dae84a520f1a-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Lock "cinder-3deb99f8-1595-444b-a575-dae84a520f1a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-3deb99f8-1595-444b-a575-dae84a520f1a" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-3deb99f8-1595-444b-a575-dae84a520f1a" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa60d51-d0aa-401a-9f4d-1266ea057f05]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:28 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a Apr 14 03:06:28 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-65aec149-18ee-422d-8760-f96546c0d85f-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-65aec149-18ee-422d-8760-f96546c0d85f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-quobyte-65aec149-18ee-422d-8760-f96546c0d85f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-65aec149-18ee-422d-8760-f96546c0d85f" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2a85b0-c8c4-4a3f-ae61-9d35b97f6498]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:28 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f Apr 14 03:06:28 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Flow 'volume_create_manager' (826ecbb8-d01f-4608-8620-276ada2a38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca4a6f9-c2e1-4711-8225-6ccec4aa6c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca4a6f9-c2e1-4711-8225-6ccec4aa6c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e1c261-921f-4aec-b897-9ffc2ac92174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c395819885a469eaef7c0be346722d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:28Z,use_quota=True,user_id='8aa499d5ffb44de7ac5862f796f1fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc541fa-381a-40a3-be82-45b1c53abf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc541fa-381a-40a3-be82-45b1c53abf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88001434-f4d3-4bd0-ad19-3166e8b67621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88001434-f4d3-4bd0-ad19-3166e8b67621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e1c261-921f-4aec-b897-9ffc2ac92174', 'volume_name': 'volume-16e1c261-921f-4aec-b897-9ffc2ac92174', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68adad7e-694b-4eb1-a395-acebfef7bb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68adad7e-694b-4eb1-a395-acebfef7bb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fefbc28-913d-489d-8492-a4762ae8acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:28 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Volume 16e1c261-921f-4aec-b897-9ffc2ac92174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e1c261-921f-4aec-b897-9ffc2ac92174', 'volume_size': 1} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e1c261-921f-4aec-b897-9ffc2ac92174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c395819885a469eaef7c0be346722d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:28Z,use_quota=True,user_id='8aa499d5ffb44de7ac5862f796f1fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Creating volume 16e1c261-921f-4aec-b897-9ffc2ac92174 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:28 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:28 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 1073741824 Apr 14 03:06:28 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:28 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a" returned: 0 in 0.527s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:28 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a Apr 14 03:06:28 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:28 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f" returned: 0 in 0.490s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:28 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f Apr 14 03:06:28 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:28 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 1073741824" returned: 0 in 0.488s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:28 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 Apr 14 03:06:28 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:28 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3deb99f8-1595-444b-a575-dae84a520f1a" returned: 0 in 0.438s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:28 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-3deb99f8-1595-444b-a575-dae84a520f1a" released by "delete_volume" :: held 0.986s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Created reservations ['5565f353-0964-4026-8d69-ae6613d05e0f', 'cb0a982b-4e4e-4630-bdc0-7b5fd4ebcb29', '42c05f7b-b6af-4437-8ea0-54d0d55e37fa', '4c134c90-0d1c-48f9-aaea-1d85c9b64cfb'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:29 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:29 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:29 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-65aec149-18ee-422d-8760-f96546c0d85f" returned: 0 in 0.458s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-65aec149-18ee-422d-8760-f96546c0d85f" released by "delete_volume" :: held 0.991s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created reservations ['36435e04-9150-43c6-b4d3-38674fee4b33', '180f94fb-081a-4732-8b16-e42e7ae82525', '70fd4bb4-b4f5-4295-b4f4-eddace3313b4', '600db8d4-fe3b-4ecb-879b-5c0e6c306592'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:29 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174" returned: 0 in 0.437s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:29 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:29 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fefbc28-913d-489d-8492-a4762ae8acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e1c261-921f-4aec-b897-9ffc2ac92174', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5a5192-68bb-457b-a38c-914eb2fcfd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:29 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Volume volume-16e1c261-921f-4aec-b897-9ffc2ac92174 (16e1c261-921f-4aec-b897-9ffc2ac92174): created successfully Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5a5192-68bb-457b-a38c-914eb2fcfd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Flow 'volume_create_manager' (826ecbb8-d01f-4608-8620-276ada2a38e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:29 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-88a34181-fb42-40aa-aa45-36afe4793a67 tempest-CinderUnicodeTest-1555656076 None] Created volume successfully. Apr 14 03:06:29 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.415s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:29 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Deleted volume successfully. Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-dd30ed89-2abf-438f-ac9c-257aa5b500fd tempest-VolumesGetTest-1479952312 None] Lock "cinder-3deb99f8-1595-444b-a575-dae84a520f1a-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:29 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.427s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:29 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Deleted volume successfully. Apr 14 03:06:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-921018b9-ea2e-405d-839a-a9c0698987e4 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-65aec149-18ee-422d-8760-f96546c0d85f-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-05eba476-a692-4ce7-a9bf-3c5cf0166693-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Lock "cinder-05eba476-a692-4ce7-a9bf-3c5cf0166693-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Acquiring lock "cinder-quobyte-05eba476-a692-4ce7-a9bf-3c5cf0166693" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-05eba476-a692-4ce7-a9bf-3c5cf0166693" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66ca2ac-251f-4999-bcc2-f2f568cec8a3]: (4, 'raw') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-3136e17e-2317-473e-8229-c575df705d44-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:30 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 Apr 14 03:06:30 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-3136e17e-2317-473e-8229-c575df705d44-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-quobyte-3136e17e-2317-473e-8229-c575df705d44" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-3136e17e-2317-473e-8229-c575df705d44" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[34502d6f-831c-4795-970f-b9ed0bebe5ef]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:30 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 Apr 14 03:06:30 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Flow 'volume_create_manager' (34b53a6a-79d1-426a-85a0-012b4d104fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf16d34-00fa-4faa-b972-2ad5cea837df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf16d34-00fa-4faa-b972-2ad5cea837df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1252242391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4298ebdc-36be-4d54-92cb-45454fbfbff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c395819885a469eaef7c0be346722d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:31Z,use_quota=True,user_id='8aa499d5ffb44de7ac5862f796f1fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6702ab97-a998-42dc-af8b-a1026e605d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6702ab97-a998-42dc-af8b-a1026e605d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23817bf2-d1a3-47ae-9bb1-5ed7ec6769d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23817bf2-d1a3-47ae-9bb1-5ed7ec6769d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4298ebdc-36be-4d54-92cb-45454fbfbff4', 'volume_name': 'volume-4298ebdc-36be-4d54-92cb-45454fbfbff4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57265dac-9544-431f-9b0a-2d1d64c382a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57265dac-9544-431f-9b0a-2d1d64c382a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07eb287-bfd2-4c8b-82b6-0e7f511f0c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:30 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Volume 4298ebdc-36be-4d54-92cb-45454fbfbff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4298ebdc-36be-4d54-92cb-45454fbfbff4', 'volume_size': 1} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1252242391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4298ebdc-36be-4d54-92cb-45454fbfbff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c395819885a469eaef7c0be346722d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:31Z,use_quota=True,user_id='8aa499d5ffb44de7ac5862f796f1fcb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Creating volume 4298ebdc-36be-4d54-92cb-45454fbfbff4 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:30 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:30 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 1073741824 Apr 14 03:06:30 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:30 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:30 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 Apr 14 03:06:30 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:30 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44" returned: 0 in 0.532s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:30 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44 Apr 14 03:06:30 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:31 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 1073741824" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:31 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693" returned: 1 in 0.468s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693' failed. Not Retrying. {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:31 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 Apr 14 03:06:31 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:31 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693 Apr 14 03:06:31 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:31 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-3136e17e-2317-473e-8229-c575df705d44" returned: 0 in 0.426s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-3136e17e-2317-473e-8229-c575df705d44" released by "delete_volume" :: held 0.985s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created reservations ['dbfd50a6-e601-454a-83ae-10b330d72fca', 'af581bb3-8db0-4868-a870-82544c11268f', '7e04e715-ca8f-45a8-8879-307f60535d0c', '8f346779-f055-4aee-9d71-57f03af56314'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:31 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:31 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:31 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07eb287-bfd2-4c8b-82b6-0e7f511f0c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4298ebdc-36be-4d54-92cb-45454fbfbff4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2543660-2ec4-42ce-95a4-6cfd4baf03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Volume volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 (4298ebdc-36be-4d54-92cb-45454fbfbff4): created successfully Apr 14 03:06:31 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2543660-2ec4-42ce-95a4-6cfd4baf03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Flow 'volume_create_manager' (34b53a6a-79d1-426a-85a0-012b4d104fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-05eba476-a692-4ce7-a9bf-3c5cf0166693" returned: 0 in 0.458s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-31485a53-90e7-4720-8738-a32fe09cbcd2 tempest-CinderUnicodeTest-1555656076 None] Created volume successfully. Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Lock "cinder-quobyte-05eba476-a692-4ce7-a9bf-3c5cf0166693" released by "delete_volume" :: held 1.461s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Created reservations ['ca41925d-4f39-4bb2-968f-ea3a1efe1ebd', '09ed6097-c66d-405a-8f55-d104fa8cc042', '17c96770-7f80-426a-a522-3e98d54847c7', 'ec37ad3b-49a7-4e01-bd16-737f42d65802'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:31 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:31 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:31 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.431s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Deleted volume successfully. Apr 14 03:06:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-e355894a-375b-47ae-8de4-bdca3aaa5c16 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-3136e17e-2317-473e-8229-c575df705d44-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:32 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.396s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Deleted volume successfully. Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-52935c5f-95b0-454d-8fc1-2c68f3c59e4d tempest-VolumesGetTest-1479952312 None] Lock "cinder-05eba476-a692-4ce7-a9bf-3c5cf0166693-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-b7394a9d-51aa-4f84-be46-2453d3feaa19-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-b7394a9d-51aa-4f84-be46-2453d3feaa19-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-quobyte-b7394a9d-51aa-4f84-be46-2453d3feaa19" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-b7394a9d-51aa-4f84-be46-2453d3feaa19" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5320b384-bc91-4a36-a0e6-7a0d3829dd6c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:32 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 Apr 14 03:06:32 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Creating offline snapshot 3abdaec8-d13e-4f83-8acb-e06f7bee9b09 of volume 4298ebdc-36be-4d54-92cb-45454fbfbff4 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88d9a7c-7b0d-4b13-9127-798688ebfb48]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:32 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 Apr 14 03:06:32 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:33 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19" returned: 0 in 0.525s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:33 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19 Apr 14 03:06:33 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:33 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4" returned: 0 in 0.548s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:33 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b7394a9d-51aa-4f84-be46-2453d3feaa19" returned: 0 in 0.464s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-b7394a9d-51aa-4f84-be46-2453d3feaa19" released by "delete_volume" :: held 1.020s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:33 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 1G Apr 14 03:06:33 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created reservations ['29420b1a-b191-4afb-a2dd-8fac11004416', '9a42b790-f5dd-45a1-8fa9-915e11110821', '2ad5b281-1ba0-436b-8000-ebb94555bffd', 'ec756de4-7785-4e8c-bd7d-c1bf5136653c'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:33 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:33 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:34 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:34 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 1G" returned: 0 in 0.574s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:34 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Deleted volume successfully. Apr 14 03:06:34 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 Apr 14 03:06:34 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c9737d9a-ecb1-451a-83f9-35b98ea97884 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-b7394a9d-51aa-4f84-be46-2453d3feaa19-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Flow 'volume_create_manager' (a4f84738-786c-454d-9370-ad7bfa53f216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d486a986-3f07-4d6a-9a9c-297baf6f917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d486a986-3f07-4d6a-9a9c-297baf6f917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-415260254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0bf80a-7cc0-4049-8670-d1090ed5683c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6217112c17c4cb1957884a17d3d48f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:34Z,use_quota=True,user_id='94b8ea61ca5a4973aafcc4b6718f3fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d427b0f-a3ee-4161-8841-1ad7413ccf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d427b0f-a3ee-4161-8841-1ad7413ccf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1412bb0b-57eb-4a76-821d-1ccf5e92a5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1412bb0b-57eb-4a76-821d-1ccf5e92a5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb0bf80a-7cc0-4049-8670-d1090ed5683c', 'volume_name': 'volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9cad1f-1e4c-4e4b-aec0-be6a7b9fe379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9cad1f-1e4c-4e4b-aec0-be6a7b9fe379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4dd515-276d-464a-94e4-5dd1bebc6975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:34 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Volume fb0bf80a-7cc0-4049-8670-d1090ed5683c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c', 'volume_size': 1} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:34 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09" returned: 0 in 0.418s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:34 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 is being set with open permissions: ugo+rw Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:34 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 Apr 14 03:06:34 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-20cd1a39-e5a4-42ee-bd21-95009c194c60-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-20cd1a39-e5a4-42ee-bd21-95009c194c60-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-quobyte-20cd1a39-e5a4-42ee-bd21-95009c194c60" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-20cd1a39-e5a4-42ee-bd21-95009c194c60" acquired by "delete_volume" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3439001d-4ad8-4aaa-acc9-549a6bcb926e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:34 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 Apr 14 03:06:34 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:34 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09" returned: 0 in 0.431s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:34 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.info Apr 14 03:06:34 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:35 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:35 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60 Apr 14 03:06:35 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:35 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.info" returned: 0 in 0.416s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:35 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.info is being set with open permissions: ugo+rw Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:35 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.info Apr 14 03:06:35 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:35 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20cd1a39-e5a4-42ee-bd21-95009c194c60" returned: 0 in 0.403s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-20cd1a39-e5a4-42ee-bd21-95009c194c60" released by "delete_volume" :: held 0.906s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created reservations ['263d1a59-6593-4b43-9e0a-7d372d908687', 'de946b01-2c88-41ba-bc09-8b3933db72da', 'a4f3ba44-bbc5-419c-91b0-c08131ab833e', '355ed98d-52af-4bde-840d-e207836f9eed'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:35 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:35 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-308a5cc2-d1be-4977-ae1f-23b865f2f585-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-308a5cc2-d1be-4977-ae1f-23b865f2f585-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-quobyte-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-quobyte-308a5cc2-d1be-4977-ae1f-23b865f2f585" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-308a5cc2-d1be-4977-ae1f-23b865f2f585" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Deleting offline snapshot 308a5cc2-d1be-4977-ae1f-23b865f2f585 of volume 1dd56062-a1bc-4fd6-8aa8-919c881bd28c {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] snapshot_file for this snap is: volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088cc5a-ae31-4d83-8d2a-4c66b73473fc]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:35 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.info" returned: 0 in 0.446s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-415260254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0bf80a-7cc0-4049-8670-d1090ed5683c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6217112c17c4cb1957884a17d3d48f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:34Z,use_quota=True,user_id='94b8ea61ca5a4973aafcc4b6718f3fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Creating volume fb0bf80a-7cc0-4049-8670-d1090ed5683c {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:35 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ad1e5460-60df-49d2-bd8b-ffc5f6adad89 tempest-CinderUnicodeTest-1555656076 None] Create snapshot completed successfully Apr 14 03:06:35 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c 1073741824 Apr 14 03:06:35 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:35 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 Apr 14 03:06:35 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "cinder-3abdaec8-d13e-4f83-8acb-e06f7bee9b09-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-3abdaec8-d13e-4f83-8acb-e06f7bee9b09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "cinder-quobyte-4298ebdc-36be-4d54-92cb-45454fbfbff4" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-quobyte-4298ebdc-36be-4d54-92cb-45454fbfbff4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "cinder-quobyte-3abdaec8-d13e-4f83-8acb-e06f7bee9b09" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-quobyte-3abdaec8-d13e-4f83-8acb-e06f7bee9b09" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Deleting offline snapshot 3abdaec8-d13e-4f83-8acb-e06f7bee9b09 of volume 4298ebdc-36be-4d54-92cb-45454fbfbff4 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:06:36 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] snapshot_file for this snap is: volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.457s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bea7364-986d-403d-bfff-618309d24bd8]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:36 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Deleted volume successfully. Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8e0cfc0a-1e17-4ab9-af4c-f1935eb8aac5 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-20cd1a39-e5a4-42ee-bd21-95009c194c60-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:36 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 Apr 14 03:06:36 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:36 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c 1073741824" returned: 0 in 0.498s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:36 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585" returned: 0 in 0.554s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3abd34c-0f31-4562-9185-a4c15196acbf]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:36 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c Apr 14 03:06:36 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:36 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c Apr 14 03:06:36 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:36 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09" returned: 0 in 0.504s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4298ebdc-36be-4d54-92cb-45454fbfbff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff9c768-f789-49a5-8c5e-9e17400ded87]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:36 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 Apr 14 03:06:36 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:36 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c" returned: 0 in 0.432s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:36 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" returned: 0 in 0.462s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:36 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 Apr 14 03:06:36 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4dd515-276d-464a-94e4-5dd1bebc6975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e3f21a-cd48-42d4-bbd8-d6be3b7e1f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:36 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Volume volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c (fb0bf80a-7cc0-4049-8670-d1090ed5683c): created successfully Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e3f21a-cd48-42d4-bbd8-d6be3b7e1f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Flow 'volume_create_manager' (a4f84738-786c-454d-9370-ad7bfa53f216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:36 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a2d86a20-1b1a-42b7-8784-978013acc57a tempest-VolumesListTestJSON-1088421431 None] Created volume successfully. Apr 14 03:06:37 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:37 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 Apr 14 03:06:37 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:37 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585" returned: 0 in 0.463s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:37 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585 Apr 14 03:06:37 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Flow 'volume_create_manager' (ed4185d0-8714-4b39-82ed-fedc9a85bcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e920fa-b48c-47fc-9eb2-c181dc1a53ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e920fa-b48c-47fc-9eb2-c181dc1a53ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-484582955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a023cf-3d29-438d-8d6b-4a9914f6e11a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6217112c17c4cb1957884a17d3d48f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:37Z,use_quota=True,user_id='94b8ea61ca5a4973aafcc4b6718f3fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2406fd-b07e-4114-ab29-e7c84b6167c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2406fd-b07e-4114-ab29-e7c84b6167c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7647786-5dc5-4e06-815b-7fdf4f93c809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7647786-5dc5-4e06-815b-7fdf4f93c809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a023cf-3d29-438d-8d6b-4a9914f6e11a', 'volume_name': 'volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50db563b-8428-43af-b85b-3496a019d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50db563b-8428-43af-b85b-3496a019d607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6bc1cd-dab6-48f6-85a6-d1176920929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:37 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Volume 21a023cf-3d29-438d-8d6b-4a9914f6e11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a', 'volume_size': 1} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-484582955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a023cf-3d29-438d-8d6b-4a9914f6e11a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6217112c17c4cb1957884a17d3d48f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:37Z,use_quota=True,user_id='94b8ea61ca5a4973aafcc4b6718f3fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Creating volume 21a023cf-3d29-438d-8d6b-4a9914f6e11a {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:37 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:37 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a 1073741824 Apr 14 03:06:37 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:37 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09" returned: 0 in 0.540s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:37 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09 Apr 14 03:06:37 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:37 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c.308a5cc2-d1be-4977-ae1f-23b865f2f585" returned: 0 in 0.423s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-308a5cc2-d1be-4977-ae1f-23b865f2f585" released by "_delete_snapshot" :: held 1.960s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" released by "delete_snapshot" :: held 1.970s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created reservations ['5d053e90-ea4c-477e-b143-8fdca9f34039', '2888baa8-542d-4faf-a162-6d9bde5c34bb', '2512bffe-323b-4c90-8af0-d680f32cd4e1', 'c597d865-119a-4718-97b3-f15454933d52'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:37 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Delete snapshot completed successfully. Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-d2a14d38-ee63-4dde-b94d-31cddfa13b98 tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-308a5cc2-d1be-4977-ae1f-23b865f2f585-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-1dd56062-a1bc-4fd6-8aa8-919c881bd28c-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-1dd56062-a1bc-4fd6-8aa8-919c881bd28c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "cinder-quobyte-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c06875-9acc-4d88-bc54-534fe2214b8a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:37 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c Apr 14 03:06:37 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:38 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4.3abdaec8-d13e-4f83-8acb-e06f7bee9b09" returned: 0 in 0.481s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:38 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-quobyte-3abdaec8-d13e-4f83-8acb-e06f7bee9b09" released by "_delete_snapshot" :: held 2.071s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a 1073741824" returned: 0 in 0.545s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-quobyte-4298ebdc-36be-4d54-92cb-45454fbfbff4" released by "delete_snapshot" :: held 2.089s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Created reservations ['331adc8a-5442-47d4-963d-938480ad342e', '1295bbf7-65c2-43bf-a641-abd24f779e91', '558eaa28-1278-487f-b2e4-7a115cc40391', 'f25da85f-7831-44a1-a1f2-97846e1dcb1b'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:38 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a Apr 14 03:06:38 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Delete snapshot completed successfully. Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9a2cdd57-18db-4c87-8580-3184b5450bc7 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-3abdaec8-d13e-4f83-8acb-e06f7bee9b09-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:38 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" returned: 0 in 0.493s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:38 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c Apr 14 03:06:38 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:38 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a" returned: 0 in 0.424s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6bc1cd-dab6-48f6-85a6-d1176920929c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6b5ef2-224e-415f-9f94-a5bbdc657a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:38 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Volume volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a (21a023cf-3d29-438d-8d6b-4a9914f6e11a): created successfully Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6b5ef2-224e-415f-9f94-a5bbdc657a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Flow 'volume_create_manager' (ed4185d0-8714-4b39-82ed-fedc9a85bcf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-fa5dce2f-db0d-4c06-81b5-c153292f7791 tempest-VolumesListTestJSON-1088421431 None] Created volume successfully. Apr 14 03:06:38 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" returned: 0 in 0.420s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-quobyte-1dd56062-a1bc-4fd6-8aa8-919c881bd28c" released by "delete_volume" :: held 0.940s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Created reservations ['f6359515-9beb-4858-aea0-fe5d4ca65d0f', 'c662623b-49f7-4622-b2d4-f4c1aae1f189', '2b8adea4-6e7c-4cce-9713-e2ac64512502', '952a93fc-2969-434d-acc8-21f21531c0af'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:38 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:38 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "cinder-4298ebdc-36be-4d54-92cb-45454fbfbff4-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-4298ebdc-36be-4d54-92cb-45454fbfbff4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "cinder-quobyte-4298ebdc-36be-4d54-92cb-45454fbfbff4" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-quobyte-4298ebdc-36be-4d54-92cb-45454fbfbff4" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd485c-1b4a-4228-98d5-3bccac31620b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:39 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 Apr 14 03:06:39 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:39 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:39 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Deleted volume successfully. Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-41ecdcf7-732e-4725-af0e-bae8b0fd41cf tempest-CreateVolumesFromSnapshotTest-1535862071 None] Lock "cinder-1dd56062-a1bc-4fd6-8aa8-919c881bd28c-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:39 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4" returned: 0 in 0.594s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:39 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4 Apr 14 03:06:39 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Flow 'volume_create_manager' (eb39b172-f9e8-4345-a25b-224b3bc67944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6d582c-99dd-4485-bc66-faa05c413d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6d582c-99dd-4485-bc66-faa05c413d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1224639738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9cf919-cc2e-4b14-8a8b-156687698eee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6217112c17c4cb1957884a17d3d48f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:40Z,use_quota=True,user_id='94b8ea61ca5a4973aafcc4b6718f3fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1a73c7-3407-478e-a2ab-6f9696ab2f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1a73c7-3407-478e-a2ab-6f9696ab2f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28187bdc-f70b-4de2-85dd-c11b12c9ea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28187bdc-f70b-4de2-85dd-c11b12c9ea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9cf919-cc2e-4b14-8a8b-156687698eee', 'volume_name': 'volume-aa9cf919-cc2e-4b14-8a8b-156687698eee', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f3cf07-0b03-41e4-8470-92b612e1736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f3cf07-0b03-41e4-8470-92b612e1736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d8c88e-cae4-48ba-ada5-26aeb4d37107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:40 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Volume aa9cf919-cc2e-4b14-8a8b-156687698eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9cf919-cc2e-4b14-8a8b-156687698eee', 'volume_size': 1} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1224639738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9cf919-cc2e-4b14-8a8b-156687698eee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6217112c17c4cb1957884a17d3d48f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:06:40Z,use_quota=True,user_id='94b8ea61ca5a4973aafcc4b6718f3fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Creating volume aa9cf919-cc2e-4b14-8a8b-156687698eee {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:06:40 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:40 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee 1073741824 Apr 14 03:06:40 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:40 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4298ebdc-36be-4d54-92cb-45454fbfbff4" returned: 0 in 0.443s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-quobyte-4298ebdc-36be-4d54-92cb-45454fbfbff4" released by "delete_volume" :: held 1.072s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Created reservations ['e162df77-03d0-4825-bef4-d0d23d521214', '0641fecb-c1f1-467d-a53f-24e5f8f60309', 'f452b458-6dd5-4264-8a95-1543b8b38941', 'b311c7d3-150f-4fb6-b77d-a023be967bd3'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:40 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:40 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:40 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee 1073741824" returned: 0 in 0.492s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:40 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee Apr 14 03:06:40 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:40 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.427s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:40 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Deleted volume successfully. Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-0f25a7ef-fc13-42d2-bb96-d10ecda29898 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-4298ebdc-36be-4d54-92cb-45454fbfbff4-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:40 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee" returned: 0 in 0.421s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d8c88e-cae4-48ba-ada5-26aeb4d37107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9cf919-cc2e-4b14-8a8b-156687698eee', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de68d53-6174-4fc6-86b9-2347ce7a7692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:06:40 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Volume volume-aa9cf919-cc2e-4b14-8a8b-156687698eee (aa9cf919-cc2e-4b14-8a8b-156687698eee): created successfully Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de68d53-6174-4fc6-86b9-2347ce7a7692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:06:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Flow 'volume_create_manager' (eb39b172-f9e8-4345-a25b-224b3bc67944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:06:40 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3a3463f7-8d6e-4bfe-8dd8-ee5ba5de2d4f tempest-VolumesListTestJSON-1088421431 None] Created volume successfully. Apr 14 03:06:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "cinder-16e1c261-921f-4aec-b897-9ffc2ac92174-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-16e1c261-921f-4aec-b897-9ffc2ac92174-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "cinder-quobyte-16e1c261-921f-4aec-b897-9ffc2ac92174" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-quobyte-16e1c261-921f-4aec-b897-9ffc2ac92174" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:41 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d621c8-5dc6-481b-bd5e-7e4c9eba7ef1]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:41 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 Apr 14 03:06:41 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:41 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174" returned: 0 in 0.466s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:41 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174 Apr 14 03:06:41 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:42 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-16e1c261-921f-4aec-b897-9ffc2ac92174" returned: 0 in 0.447s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-quobyte-16e1c261-921f-4aec-b897-9ffc2ac92174" released by "delete_volume" :: held 0.937s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Created reservations ['df3d9a6b-e1a9-43ff-ab7f-347737bb8780', 'b6fdd9a6-656b-42a1-a973-88564407986d', '6a0fd0f6-a090-43ae-b73e-84365773bdd0', 'cc518447-c13a-4f19-9690-aa65bef03906'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:42 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:42 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:42 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.521s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:42 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:42 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Deleted volume successfully. Apr 14 03:06:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-331f27c7-4aa7-445c-8ff2-b3ef65ac37d1 tempest-CinderUnicodeTest-1555656076 None] Lock "cinder-16e1c261-921f-4aec-b897-9ffc2ac92174-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "cinder-aa9cf919-cc2e-4b14-8a8b-156687698eee-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-aa9cf919-cc2e-4b14-8a8b-156687698eee-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "cinder-quobyte-aa9cf919-cc2e-4b14-8a8b-156687698eee" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-quobyte-aa9cf919-cc2e-4b14-8a8b-156687698eee" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:44 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[053a756b-8fcb-4c78-a332-136bbd4acac7]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:44 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee Apr 14 03:06:44 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:44 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee" returned: 0 in 0.500s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:44 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee Apr 14 03:06:44 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:45 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-aa9cf919-cc2e-4b14-8a8b-156687698eee" returned: 0 in 0.426s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-quobyte-aa9cf919-cc2e-4b14-8a8b-156687698eee" released by "delete_volume" :: held 0.955s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Created reservations ['12702d30-e798-4a27-ae47-e1abf1851c44', '5f6b6181-bdc3-44cd-b351-fe84f462946a', 'b8a351c4-6301-4819-a8b7-6e461abce63d', '7a8d54e7-cc05-46c5-a181-0e40969e742f'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:45 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:45 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "cinder-21a023cf-3d29-438d-8d6b-4a9914f6e11a-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-21a023cf-3d29-438d-8d6b-4a9914f6e11a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "cinder-quobyte-21a023cf-3d29-438d-8d6b-4a9914f6e11a" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-quobyte-21a023cf-3d29-438d-8d6b-4a9914f6e11a" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e83677b-eb46-4575-9bca-9cd6bc8f8ede]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:45 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a Apr 14 03:06:45 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:45 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.451s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:45 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Deleted volume successfully. Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-ae643438-4998-44b3-a0c1-76bfb94b1db8 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-aa9cf919-cc2e-4b14-8a8b-156687698eee-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:45 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a" returned: 0 in 0.476s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:45 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a Apr 14 03:06:45 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:46 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-21a023cf-3d29-438d-8d6b-4a9914f6e11a" returned: 0 in 0.415s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-quobyte-21a023cf-3d29-438d-8d6b-4a9914f6e11a" released by "delete_volume" :: held 0.912s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Created reservations ['5fa35cb7-4f6f-4068-8faf-79c05dd4ba2a', 'b1ff21ad-95d5-4269-afde-a0b6ebcb8f2c', 'ca887266-8e87-4179-821b-98a231312715', '505245dc-0aea-4f3a-acec-ba99d473b00e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:46 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:46 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "cinder-fb0bf80a-7cc0-4049-8670-d1090ed5683c-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-fb0bf80a-7cc0-4049-8670-d1090ed5683c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "cinder-quobyte-fb0bf80a-7cc0-4049-8670-d1090ed5683c" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-quobyte-fb0bf80a-7cc0-4049-8670-d1090ed5683c" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1507a428-f97f-411e-a3ee-3cd227327e99]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:46 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c Apr 14 03:06:46 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:46 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.443s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:46 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Deleted volume successfully. Apr 14 03:06:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-62656036-0472-4373-b98a-830939ded080 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-21a023cf-3d29-438d-8d6b-4a9914f6e11a-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:47 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c" returned: 0 in 0.478s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:47 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c Apr 14 03:06:47 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:47 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fb0bf80a-7cc0-4049-8670-d1090ed5683c" returned: 0 in 0.413s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-quobyte-fb0bf80a-7cc0-4049-8670-d1090ed5683c" released by "delete_volume" :: held 0.911s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Created reservations ['56b07a52-012c-49c7-8892-8dbc78f8114f', 'dc2b2a92-8bf6-43e9-9d92-cf9f15f66965', '9b721c25-0c93-41a0-80f0-ab2caa94b761', '3f12bc9c-dc57-472a-8390-747e84e84637'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:06:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:06:47 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:06:47 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:06:48 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 14 03:06:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:06:48 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:06:48 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Deleted volume successfully. Apr 14 03:06:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-fd9c24d5-8fb3-423d-b1d0-8615e0590f86 tempest-VolumesListTestJSON-1088421431 None] Lock "cinder-fb0bf80a-7cc0-4049-8670-d1090ed5683c-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:06:57 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=143,cinder:UPDATE=212,cinder:DELETE=17,cinder:INSERT=50 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:06:58 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:UPDATE=180,cinder:SELECT=127,cinder:INSERT=54,cinder:DELETE=15 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Flow 'volume_create_manager' (64d5b892-d1ed-4108-bad3-90ff7a74dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774911aa-6024-4937-8ff0-0d8a95a86574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774911aa-6024-4937-8ff0-0d8a95a86574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-857888599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab5b557-e2ed-4487-a983-73568d7cd2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bac34cac79465e8ca6938c44280bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:02Z,use_quota=True,user_id='58c3e77ec18244be935f6a59a28d293a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1063f8-1f07-4cf9-b0cb-3fe5e7836850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1063f8-1f07-4cf9-b0cb-3fe5e7836850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5431e687-b60c-41d4-9ec1-072fc0572283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5431e687-b60c-41d4-9ec1-072fc0572283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab5b557-e2ed-4487-a983-73568d7cd2a7', 'volume_name': 'volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badfeb20-4edb-4a08-a5c3-0efbc166b4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badfeb20-4edb-4a08-a5c3-0efbc166b4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5d90b5-8789-4aee-80af-bad5af26d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:02 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Volume 9ab5b557-e2ed-4487-a983-73568d7cd2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7', 'volume_size': 1} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-857888599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab5b557-e2ed-4487-a983-73568d7cd2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bac34cac79465e8ca6938c44280bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:02Z,use_quota=True,user_id='58c3e77ec18244be935f6a59a28d293a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Creating volume 9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:02 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:02 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 1073741824 Apr 14 03:07:02 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:02 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 1073741824" returned: 0 in 0.476s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:02 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 Apr 14 03:07:02 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:03 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7" returned: 0 in 0.408s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5d90b5-8789-4aee-80af-bad5af26d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8607c69d-c69d-4af7-a4b3-2d1e11c8b8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:03 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Volume volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 (9ab5b557-e2ed-4487-a983-73568d7cd2a7): created successfully Apr 14 03:07:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8607c69d-c69d-4af7-a4b3-2d1e11c8b8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:03 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Flow 'volume_create_manager' (64d5b892-d1ed-4108-bad3-90ff7a74dc85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:03 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e38b6dad-c8a2-41f5-8298-dd91cf6fb325 tempest-SnapshotDependencyTests-1831719966 None] Created volume successfully. Apr 14 03:07:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Creating offline snapshot 1b7f960d-f16e-4fba-8e56-bce017110f88 of volume 9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:07:04 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a6d442-7de7-4e50-868e-d958c6525d1c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:04 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 Apr 14 03:07:04 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:05 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:05 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 1G Apr 14 03:07:05 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:05 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 1G" returned: 0 in 0.456s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:05 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 Apr 14 03:07:05 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:05 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88" returned: 0 in 0.431s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:05 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 is being set with open permissions: ugo+rw Apr 14 03:07:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:06 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 Apr 14 03:07:06 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:06 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88" returned: 0 in 0.423s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:06 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.info Apr 14 03:07:06 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:06 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.info" returned: 0 in 0.407s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:06 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.info is being set with open permissions: ugo+rw Apr 14 03:07:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:06 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.info Apr 14 03:07:06 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:07 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.info" returned: 0 in 0.393s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:07 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-0e0c359b-f22e-4fb6-acb5-62b1e0ebc4b8 tempest-SnapshotDependencyTests-1831719966 None] Create snapshot completed successfully Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Flow 'volume_create_manager' (8c7f2861-91af-4fb5-8eb1-43992637bd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c460d87c-e7b1-4cb4-b0d6-7e20cf0d6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c460d87c-e7b1-4cb4-b0d6-7e20cf0d6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90025b9-3afc-4a12-acb4-369591061b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84bac34cac79465e8ca6938c44280bea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b7f960d-f16e-4fba-8e56-bce017110f88,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:08Z,use_quota=True,user_id='58c3e77ec18244be935f6a59a28d293a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b660b73b-46a5-4d48-9433-fe8408b62fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b660b73b-46a5-4d48-9433-fe8408b62fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0769858c-6860-42e6-83bf-3a5bed514f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0769858c-6860-42e6-83bf-3a5bed514f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f90025b9-3afc-4a12-acb4-369591061b48', 'volume_name': 'volume-f90025b9-3afc-4a12-acb4-369591061b48', 'volume_size': 1, 'snapshot_id': '1b7f960d-f16e-4fba-8e56-bce017110f88'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96806502-1b96-48b9-9167-d8c93998dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96806502-1b96-48b9-9167-d8c93998dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed59a466-33fc-4988-8c1f-c764e8c06344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:08 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Volume f90025b9-3afc-4a12-acb4-369591061b48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f90025b9-3afc-4a12-acb4-369591061b48', 'volume_size': 1, 'snapshot_id': '1b7f960d-f16e-4fba-8e56-bce017110f88'} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-quobyte-1b7f960d-f16e-4fba-8e56-bce017110f88-f90025b9-3afc-4a12-acb4-369591061b48" by "_create_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-1b7f960d-f16e-4fba-8e56-bce017110f88-f90025b9-3afc-4a12-acb4-369591061b48" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Creating volume f90025b9-3afc-4a12-acb4-369591061b48 from snapshot 1b7f960d-f16e-4fba-8e56-bce017110f88 {{(pid=82473) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-quobyte-f90025b9-3afc-4a12-acb4-369591061b48" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-f90025b9-3afc-4a12-acb4-369591061b48" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] snapshot: 1b7f960d-f16e-4fba-8e56-bce017110f88, volume: f90025b9-3afc-4a12-acb4-369591061b48, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[22710fe5-94ea-478f-994a-4412c201c2a8]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:08 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 Apr 14 03:07:08 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:08 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4009fa9-9049-4f5d-8100-0c8ffed87d26]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:08 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 Apr 14 03:07:08 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:09 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7" returned: 0 in 0.463s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:09 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:07:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:09 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 Apr 14 03:07:09 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:10 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48" returned: 0 in 1.861s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:10 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ebf327-38be-468f-bf8e-1922c6d4a7e1]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:11 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 Apr 14 03:07:11 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:11 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7" returned: 0 in 0.570s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7, size 1024.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:07:11 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Converted 1024.00 MB image at 549.75 MB/s Apr 14 03:07:11 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 is being set with open permissions: ugo+rw Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:11 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 Apr 14 03:07:11 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:11 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48" returned: 0 in 0.396s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-f90025b9-3afc-4a12-acb4-369591061b48" released by "_copy_volume_from_snapshot" :: held 3.811s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-1b7f960d-f16e-4fba-8e56-bce017110f88-f90025b9-3afc-4a12-acb4-369591061b48" released by "_create_volume_from_snapshot" :: held 3.826s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.834s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed59a466-33fc-4988-8c1f-c764e8c06344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90025b9-3afc-4a12-acb4-369591061b48', 'volume_size': 1, 'snapshot_id': '1b7f960d-f16e-4fba-8e56-bce017110f88'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1429d83-7b3f-41e3-af0c-fafba7e4e274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:11 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Volume volume-f90025b9-3afc-4a12-acb4-369591061b48 (f90025b9-3afc-4a12-acb4-369591061b48): created successfully Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1429d83-7b3f-41e3-af0c-fafba7e4e274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:11 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Flow 'volume_create_manager' (8c7f2861-91af-4fb5-8eb1-43992637bd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:11 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-676f3b68-d980-416d-a3e8-5a45abf1eaa4 tempest-SnapshotDependencyTests-1831719966 None] Created volume successfully. Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-1b7f960d-f16e-4fba-8e56-bce017110f88-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-1b7f960d-f16e-4fba-8e56-bce017110f88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-quobyte-9ab5b557-e2ed-4487-a983-73568d7cd2a7" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-9ab5b557-e2ed-4487-a983-73568d7cd2a7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-quobyte-1b7f960d-f16e-4fba-8e56-bce017110f88" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-1b7f960d-f16e-4fba-8e56-bce017110f88" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Deleting offline snapshot 1b7f960d-f16e-4fba-8e56-bce017110f88 of volume 9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] snapshot_file for this snap is: volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[664b1d7f-9a61-49af-bcbe-9a380c41eae1]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:12 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 Apr 14 03:07:12 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:12 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88" returned: 0 in 0.459s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[60342d8f-445b-41ce-ae26-fec0d8656b72]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:12 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 Apr 14 03:07:12 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:13 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7" returned: 0 in 0.489s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:13 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 Apr 14 03:07:13 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:13 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:13 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88 Apr 14 03:07:13 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:14 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7.1b7f960d-f16e-4fba-8e56-bce017110f88" returned: 0 in 0.396s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-1b7f960d-f16e-4fba-8e56-bce017110f88" released by "_delete_snapshot" :: held 1.828s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-9ab5b557-e2ed-4487-a983-73568d7cd2a7" released by "delete_snapshot" :: held 1.840s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Created reservations ['4a4b9b2b-e584-4d19-81e6-cc41e8d21a4b', '27394483-e769-4051-acc6-f5d7c40d7da2', '8ebab6bb-9722-4795-8306-09342e977798', 'b37fbf75-6897-4cf4-904e-3b140cc98213'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:14 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Delete snapshot completed successfully. Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-08c85aa2-062f-4aa8-a1fd-c96601d77525 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-1b7f960d-f16e-4fba-8e56-bce017110f88-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-9ab5b557-e2ed-4487-a983-73568d7cd2a7-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-9ab5b557-e2ed-4487-a983-73568d7cd2a7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-quobyte-9ab5b557-e2ed-4487-a983-73568d7cd2a7" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-9ab5b557-e2ed-4487-a983-73568d7cd2a7" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[299834b3-c304-4f07-84c4-49266cbb8f8a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:14 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 Apr 14 03:07:14 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:14 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:14 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:14 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7" returned: 0 in 0.465s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:14 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7 Apr 14 03:07:14 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:15 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.404s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:15 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-9ab5b557-e2ed-4487-a983-73568d7cd2a7" returned: 0 in 0.395s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-9ab5b557-e2ed-4487-a983-73568d7cd2a7" released by "delete_volume" :: held 0.895s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Created reservations ['2c887088-7759-46bd-a658-42e15cb7dfc2', '52a53b87-9c99-4bb8-97bc-25f5ba34b08b', 'ab69ed97-f508-42c5-8f21-1f76698f5200', 'a3555f84-1520-4289-be79-40b5edcf6f29'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:15 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:15 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-f90025b9-3afc-4a12-acb4-369591061b48-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-f90025b9-3afc-4a12-acb4-369591061b48-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "cinder-quobyte-f90025b9-3afc-4a12-acb4-369591061b48" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-f90025b9-3afc-4a12-acb4-369591061b48" acquired by "delete_volume" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b77835f-21a3-4285-a11b-c96d9bfaa4f9]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:15 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 Apr 14 03:07:15 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:15 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.428s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:15 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Deleted volume successfully. Apr 14 03:07:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f35fc3f5-3bec-4f94-8d7c-6dd3440f3f5a tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-9ab5b557-e2ed-4487-a983-73568d7cd2a7-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:16 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:16 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48 Apr 14 03:07:16 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:16 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f90025b9-3afc-4a12-acb4-369591061b48" returned: 0 in 0.406s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-quobyte-f90025b9-3afc-4a12-acb4-369591061b48" released by "delete_volume" :: held 0.896s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Created reservations ['afac6dda-1dbe-4cdd-9e51-3949781878c5', '04716306-2d59-4a85-9c37-d9764248b9cd', 'fbb540d0-6068-43a5-a4d1-8fddad7b92bb', '09de038c-6642-438b-8f27-493e1d4f630c'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:16 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:16 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:16 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.448s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:16 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:16 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Deleted volume successfully. Apr 14 03:07:17 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c21b2062-4968-4a76-a92d-6e567c28f533 tempest-SnapshotDependencyTests-1831719966 None] Lock "cinder-f90025b9-3afc-4a12-acb4-369591061b48-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:26 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=25,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=6 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:07:27 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=3 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (64b113d5-fab2-4c27-b14b-4fc82e63c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3c6ab0-0070-4eae-86d0-cb6045e4ca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b3c6ab0-0070-4eae-86d0-cb6045e4ca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-144280712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32caf73e-da26-4126-a82d-475a5e89e04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:28Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13925b35-2e63-45ee-813f-a7c8a806abc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13925b35-2e63-45ee-813f-a7c8a806abc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee3f5a1-bc30-45ca-bab3-891529b5272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee3f5a1-bc30-45ca-bab3-891529b5272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32caf73e-da26-4126-a82d-475a5e89e04f', 'volume_name': 'volume-32caf73e-da26-4126-a82d-475a5e89e04f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a69cd5a-06b1-4fea-8b36-c408bddee109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a69cd5a-06b1-4fea-8b36-c408bddee109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92e0684-6e34-4f6c-ac49-17ed28a47431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume 32caf73e-da26-4126-a82d-475a5e89e04f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32caf73e-da26-4126-a82d-475a5e89e04f', 'volume_size': 1} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-144280712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32caf73e-da26-4126-a82d-475a5e89e04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:28Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Creating volume 32caf73e-da26-4126-a82d-475a5e89e04f {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:28 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:28 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f 1073741824 Apr 14 03:07:28 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (295b7ac6-8fe3-4cbb-b0a2-76da3096a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e5cdd8-b109-4251-a3a9-63952ca14faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e5cdd8-b109-4251-a3a9-63952ca14faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-777741188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd04805c-46f5-405a-a78d-08d279c0df9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:28Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f394d124-8e3f-47e2-b2ec-5a04bcc4e2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f394d124-8e3f-47e2-b2ec-5a04bcc4e2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142c9938-776f-482b-b50f-0c18c67ea3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142c9938-776f-482b-b50f-0c18c67ea3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd04805c-46f5-405a-a78d-08d279c0df9a', 'volume_name': 'volume-fd04805c-46f5-405a-a78d-08d279c0df9a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c11852-2291-4809-a632-73ae91b1bdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c11852-2291-4809-a632-73ae91b1bdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc51d2e-fe07-4e28-89b9-60d4daca0ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Volume fd04805c-46f5-405a-a78d-08d279c0df9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd04805c-46f5-405a-a78d-08d279c0df9a', 'volume_size': 1} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Flow 'volume_create_manager' (8a9e88c6-2ae7-4ea7-9685-ef060219ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa3843c-205a-45b7-8f00-47445230e168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa3843c-205a-45b7-8f00-47445230e168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1737942438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c01976-94ba-4a27-bc0a-806c2c51fdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f11e06ce0b46cf80a542b13602a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='589d33b375634f23a5d1deb2072a6de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fb08da-fc1b-438a-bc89-4ee863b418b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fb08da-fc1b-438a-bc89-4ee863b418b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45de67f-a1e4-44b9-aaff-672c50020f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45de67f-a1e4-44b9-aaff-672c50020f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c01976-94ba-4a27-bc0a-806c2c51fdcb', 'volume_name': 'volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cced9e1-fcf7-4303-8f26-60b8ba6067ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cced9e1-fcf7-4303-8f26-60b8ba6067ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e793bf4-8ffe-4391-ac12-7b6e42d1c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Volume 86c01976-94ba-4a27-bc0a-806c2c51fdcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb', 'volume_size': 1} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (4140186c-be67-4568-a168-c187aa5523ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4953853-602d-438e-b0ff-e30d69a870e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4953853-602d-438e-b0ff-e30d69a870e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-174583833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05ac433-bcb8-4cca-b5c3-353eb5282b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51944d6e-6802-43b1-90b7-d66b6690fbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51944d6e-6802-43b1-90b7-d66b6690fbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb7aa8b-1e09-41f8-8a86-6ca2cb951f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb7aa8b-1e09-41f8-8a86-6ca2cb951f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05ac433-bcb8-4cca-b5c3-353eb5282b66', 'volume_name': 'volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9402e551-9ded-46a7-bb5e-5b75932dbedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9402e551-9ded-46a7-bb5e-5b75932dbedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c0632a-a22a-44e1-a83d-f8500004c42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume b05ac433-bcb8-4cca-b5c3-353eb5282b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66', 'volume_size': 1} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (3bd6764e-e250-4a8c-bc5b-05748f4364a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05e149a-ad09-43d9-ba4d-07b80161e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05e149a-ad09-43d9-ba4d-07b80161e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-609963907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb90f2f1-ef67-441b-ba2b-cc84e94ba768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c11b00d-368e-491a-971f-21797af6d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c11b00d-368e-491a-971f-21797af6d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a13606f-bfc1-4353-a7ca-bd4553278504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a13606f-bfc1-4353-a7ca-bd4553278504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb90f2f1-ef67-441b-ba2b-cc84e94ba768', 'volume_name': 'volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86118fcb-e6bc-422d-a287-c4268a1579c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86118fcb-e6bc-422d-a287-c4268a1579c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43c9a36-bb90-42ec-b936-1e72bff2e492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:28 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Volume bb90f2f1-ef67-441b-ba2b-cc84e94ba768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768', 'volume_size': 1} Apr 14 03:07:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:29 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (579cab57-182a-4a0a-a384-6d23a4656b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bd4554-d9b5-4bdd-a105-6fed6d621ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f 1073741824" returned: 0 in 0.666s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bd4554-d9b5-4bdd-a105-6fed6d621ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084593419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04148dff-0ca3-487a-9648-eaec21118c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b92ae6-40bd-4a2f-8978-9b284a589c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b92ae6-40bd-4a2f-8978-9b284a589c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01d3cc6-7165-4d93-b0d3-fe9fb661b3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01d3cc6-7165-4d93-b0d3-fe9fb661b3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04148dff-0ca3-487a-9648-eaec21118c8b', 'volume_name': 'volume-04148dff-0ca3-487a-9648-eaec21118c8b', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b93643-2da6-4217-8193-718e6bdf4ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b93643-2da6-4217-8193-718e6bdf4ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd5fb59-6457-47fd-a9f0-0c5ff2c585c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Volume 04148dff-0ca3-487a-9648-eaec21118c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04148dff-0ca3-487a-9648-eaec21118c8b', 'volume_size': 1} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:29 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f Apr 14 03:07:29 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (c4aa9a25-feee-4cb0-a7a8-816c52a031ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a376227-8b7b-4132-9380-2fadcf35f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a376227-8b7b-4132-9380-2fadcf35f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724747337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d411fb-91fc-4c4c-b81d-550ffed2405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c5be71-020e-4111-a73e-92637f6f01c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c5be71-020e-4111-a73e-92637f6f01c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fa9a96-d47a-4a51-b770-c655b0b92919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fa9a96-d47a-4a51-b770-c655b0b92919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d411fb-91fc-4c4c-b81d-550ffed2405c', 'volume_name': 'volume-53d411fb-91fc-4c4c-b81d-550ffed2405c', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3695c1-3c1f-4156-8782-95810df7d4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3695c1-3c1f-4156-8782-95810df7d4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5ef471-cf20-4269-863b-87f50cf13c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Volume 53d411fb-91fc-4c4c-b81d-550ffed2405c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d411fb-91fc-4c4c-b81d-550ffed2405c', 'volume_size': 1} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (f3652fa1-3b21-41d7-bd85-8ede65ad2bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4aaf36-7e9a-41fe-b356-9b1ab9882b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4aaf36-7e9a-41fe-b356-9b1ab9882b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-186226011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d852c0-321c-4874-9583-e8bd65864f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66978f7-e86f-4725-ab24-2302a7650512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66978f7-e86f-4725-ab24-2302a7650512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3b9e5e-9ceb-4fa7-a755-c15a9811ff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3b9e5e-9ceb-4fa7-a755-c15a9811ff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d852c0-321c-4874-9583-e8bd65864f69', 'volume_name': 'volume-f4d852c0-321c-4874-9583-e8bd65864f69', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b00e58-c7ac-4cc1-8d21-77a9fe629ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b00e58-c7ac-4cc1-8d21-77a9fe629ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41886852-87b2-4bb2-aa3a-9e8fac3ee8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Volume f4d852c0-321c-4874-9583-e8bd65864f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d852c0-321c-4874-9583-e8bd65864f69', 'volume_size': 1} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:29 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-777741188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd04805c-46f5-405a-a78d-08d279c0df9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:28Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Creating volume fd04805c-46f5-405a-a78d-08d279c0df9a {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:29 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:29 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a 1073741824 Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92e0684-6e34-4f6c-ac49-17ed28a47431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32caf73e-da26-4126-a82d-475a5e89e04f', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b972a8a-87b7-4063-b26d-efe992e188e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:29 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume volume-32caf73e-da26-4126-a82d-475a5e89e04f (32caf73e-da26-4126-a82d-475a5e89e04f): created successfully Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b972a8a-87b7-4063-b26d-efe992e188e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:29 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (64b113d5-fab2-4c27-b14b-4fc82e63c635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:29 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7593d010-22cf-4b81-916f-9ce04c83e75d tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created volume successfully. Apr 14 03:07:30 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a 1073741824" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:30 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a Apr 14 03:07:30 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:30 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a" returned: 0 in 0.398s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.770s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1737942438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c01976-94ba-4a27-bc0a-806c2c51fdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f11e06ce0b46cf80a542b13602a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='589d33b375634f23a5d1deb2072a6de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Creating volume 86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:30 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc51d2e-fe07-4e28-89b9-60d4daca0ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd04805c-46f5-405a-a78d-08d279c0df9a', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:30 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb 1073741824 Apr 14 03:07:30 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c527263-3637-427f-9ea1-6966bb454593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:30 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Volume volume-fd04805c-46f5-405a-a78d-08d279c0df9a (fd04805c-46f5-405a-a78d-08d279c0df9a): created successfully Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c527263-3637-427f-9ea1-6966bb454593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (295b7ac6-8fe3-4cbb-b0a2-76da3096a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:30 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ca93fa07-277b-4c53-8bec-571f09e6ac92 tempest-CreateVolumesFromImageTest-118666478 None] Created volume successfully. Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (ec8cd45f-a2c8-4c39-9d41-fb690d4844fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50614fa5-74e3-4276-9127-a46d5fc63579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50614fa5-74e3-4276-9127-a46d5fc63579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200162835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd3618a-a077-4b9b-89a7-7b93bccfc127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:31Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac742421-f576-4fd5-bfbc-8815363a111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:30 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac742421-f576-4fd5-bfbc-8815363a111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cf88a8-cacb-4436-acfc-c7faeecbe922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cf88a8-cacb-4436-acfc-c7faeecbe922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd3618a-a077-4b9b-89a7-7b93bccfc127', 'volume_name': 'volume-edd3618a-a077-4b9b-89a7-7b93bccfc127', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:30 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcaff2fd-35ed-40f1-aba9-bc114f55ab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcaff2fd-35ed-40f1-aba9-bc114f55ab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf86f3f-967f-4f81-9fa3-1d4fc5aaf22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume edd3618a-a077-4b9b-89a7-7b93bccfc127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd3618a-a077-4b9b-89a7-7b93bccfc127', 'volume_size': 1} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb 1073741824" returned: 0 in 0.518s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:31 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb Apr 14 03:07:31 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (28e7b712-4d0e-4c85-9094-f98a11df7d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20c9247-fde1-4b7f-913d-562c79ef75b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20c9247-fde1-4b7f-913d-562c79ef75b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-433465071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8fd5bbf-d2c7-483a-a31a-424b6d74df08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:31Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5672b32-ce73-49aa-8a1d-11dc5b4ca224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5672b32-ce73-49aa-8a1d-11dc5b4ca224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e31ddc4-5731-4a60-a294-59a979423e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e31ddc4-5731-4a60-a294-59a979423e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8fd5bbf-d2c7-483a-a31a-424b6d74df08', 'volume_name': 'volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbc3fb6-654a-4c50-b53f-3d486f1f3ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbc3fb6-654a-4c50-b53f-3d486f1f3ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6baf42a-a487-4540-b930-dca715674bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume b8fd5bbf-d2c7-483a-a31a-424b6d74df08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08', 'volume_size': 1} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (3317e9a3-18f1-4e7a-992c-ec5f9266d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1836a09-69b9-47d3-872a-d263d27aeb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1836a09-69b9-47d3-872a-d263d27aeb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-299186346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613bc9de-4f47-4151-979f-6074a78122db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:31Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2da276-d9b3-4161-b500-5573eefca448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2da276-d9b3-4161-b500-5573eefca448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89de7e5-3c98-41f6-b2be-c328493a75c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89de7e5-3c98-41f6-b2be-c328493a75c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613bc9de-4f47-4151-979f-6074a78122db', 'volume_name': 'volume-613bc9de-4f47-4151-979f-6074a78122db', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dda601e-1aaf-46bf-a6db-6dd94af32a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dda601e-1aaf-46bf-a6db-6dd94af32a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec2ef3f-a2f3-4141-b7d2-3d00853382ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume 613bc9de-4f47-4151-979f-6074a78122db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613bc9de-4f47-4151-979f-6074a78122db', 'volume_size': 1} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (ff4e4a4e-4396-452e-9a3e-3f1e16542c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b046088-7224-4841-9d38-92f8b06fa9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b046088-7224-4841-9d38-92f8b06fa9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1477085499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:31Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039076a4-a6c7-4c1f-b4d0-30031cab9266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039076a4-a6c7-4c1f-b4d0-30031cab9266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b626be67-a0e2-4017-9609-1ddfcee2039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b626be67-a0e2-4017-9609-1ddfcee2039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e', 'volume_name': 'volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606416bc-17fe-4585-aeb0-763150ed9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606416bc-17fe-4585-aeb0-763150ed9f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2178d19-6b80-4895-a236-ad7b8ba25003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume 14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e', 'volume_size': 1} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:31 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb" returned: 0 in 0.541s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.765s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-174583833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05ac433-bcb8-4cca-b5c3-353eb5282b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Creating volume b05ac433-bcb8-4cca-b5c3-353eb5282b66 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:31 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e793bf4-8ffe-4391-ac12-7b6e42d1c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 1073741824 Apr 14 03:07:31 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff65635a-6e09-445f-a27f-87e3faea6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Volume volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb (86c01976-94ba-4a27-bc0a-806c2c51fdcb): created successfully Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff65635a-6e09-445f-a27f-87e3faea6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Flow 'volume_create_manager' (8a9e88c6-2ae7-4ea7-9685-ef060219ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:31 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-dd28f92f-0417-4cfc-811b-1ee1cbefe8f7 tempest-VolumeDependencyTests-2099042358 None] Created volume successfully. Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (d4f06c22-2010-4034-bedc-80d85b470354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4630fd75-6264-4b8a-9c07-07908dfb2bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4630fd75-6264-4b8a-9c07-07908dfb2bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1719014637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a33547f-983f-4048-bdb3-00f996dc03fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:32Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719331c7-ee6a-4a2b-9bfe-3db00a0a0a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719331c7-ee6a-4a2b-9bfe-3db00a0a0a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4696bd2d-c018-4171-8d10-968e88fc93ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4696bd2d-c018-4171-8d10-968e88fc93ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a33547f-983f-4048-bdb3-00f996dc03fc', 'volume_name': 'volume-2a33547f-983f-4048-bdb3-00f996dc03fc', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13343a0f-403b-43bb-b53d-9bf8d1cc8dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13343a0f-403b-43bb-b53d-9bf8d1cc8dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422f1ce1-4021-4079-bd5e-a5b9940d06e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:31 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume 2a33547f-983f-4048-bdb3-00f996dc03fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a33547f-983f-4048-bdb3-00f996dc03fc', 'volume_size': 1} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:32 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 1073741824" returned: 0 in 0.532s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:32 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 Apr 14 03:07:32 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:32 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66" returned: 0 in 0.402s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.635s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-609963907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb90f2f1-ef67-441b-ba2b-cc84e94ba768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Creating volume bb90f2f1-ef67-441b-ba2b-cc84e94ba768 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:32 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c0632a-a22a-44e1-a83d-f8500004c42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:32 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 1073741824 Apr 14 03:07:32 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a9075a-00df-4158-ad7d-812b56128c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:32 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 (b05ac433-bcb8-4cca-b5c3-353eb5282b66): created successfully Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a9075a-00df-4158-ad7d-812b56128c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:32 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (4140186c-be67-4568-a168-c187aa5523ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c6ae1852-f540-4193-9506-610ec8b635a7 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created volume successfully. Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:33 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 1073741824" returned: 0 in 0.513s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:33 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 Apr 14 03:07:33 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:33 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768" returned: 0 in 0.401s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.382s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084593419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04148dff-0ca3-487a-9648-eaec21118c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Creating volume 04148dff-0ca3-487a-9648-eaec21118c8b {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:33 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43c9a36-bb90-42ec-b936-1e72bff2e492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0865199b-598b-4df1-84a0-8bad3383dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:33 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b 1073741824 Apr 14 03:07:33 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:33 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Volume volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 (bb90f2f1-ef67-441b-ba2b-cc84e94ba768): created successfully Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0865199b-598b-4df1-84a0-8bad3383dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (3bd6764e-e250-4a8c-bc5b-05748f4364a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:33 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-402017d8-f91c-466d-a97f-ac5ca334d7a5 tempest-CreateVolumesFromImageTest-118666478 None] Created volume successfully. Apr 14 03:07:33 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b 1073741824" returned: 0 in 0.483s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:34 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b Apr 14 03:07:34 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:34 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b" returned: 0 in 0.387s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.123s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1724747337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d411fb-91fc-4c4c-b81d-550ffed2405c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Creating volume 53d411fb-91fc-4c4c-b81d-550ffed2405c {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:34 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd5fb59-6457-47fd-a9f0-0c5ff2c585c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04148dff-0ca3-487a-9648-eaec21118c8b', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d5f0d8-0781-448f-8d59-e71a500f0efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:34 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c 1073741824 Apr 14 03:07:34 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:34 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Volume volume-04148dff-0ca3-487a-9648-eaec21118c8b (04148dff-0ca3-487a-9648-eaec21118c8b): created successfully Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d5f0d8-0781-448f-8d59-e71a500f0efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (579cab57-182a-4a0a-a384-6d23a4656b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:34 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-e77e81d9-8f62-4fe0-b606-d34b075c5aec tempest-CreateVolumesFromImageTest-118666478 None] Created volume successfully. Apr 14 03:07:34 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c 1073741824" returned: 0 in 0.488s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:34 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:34 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c Apr 14 03:07:34 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:35 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c" returned: 0 in 0.393s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.883s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-186226011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d852c0-321c-4874-9583-e8bd65864f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383f97280f6c4877ab0006cff1ad6da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:29Z,use_quota=True,user_id='9726339851634abc8fc225703226d69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Creating volume f4d852c0-321c-4874-9583-e8bd65864f69 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:35 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5ef471-cf20-4269-863b-87f50cf13c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d411fb-91fc-4c4c-b81d-550ffed2405c', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:35 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 1073741824 Apr 14 03:07:35 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99cb75c6-3327-4a69-b71a-766eb94790cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:35 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Volume volume-53d411fb-91fc-4c4c-b81d-550ffed2405c (53d411fb-91fc-4c4c-b81d-550ffed2405c): created successfully Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99cb75c6-3327-4a69-b71a-766eb94790cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (c4aa9a25-feee-4cb0-a7a8-816c52a031ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:35 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-cd8a40b8-68f8-4253-97a1-94689a4cef10 tempest-CreateVolumesFromImageTest-118666478 None] Created volume successfully. Apr 14 03:07:35 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 1073741824" returned: 0 in 0.467s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:35 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:35 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 Apr 14 03:07:35 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:36 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69" returned: 0 in 0.396s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.179s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200162835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd3618a-a077-4b9b-89a7-7b93bccfc127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:31Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Creating volume edd3618a-a077-4b9b-89a7-7b93bccfc127 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:36 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41886852-87b2-4bb2-aa3a-9e8fac3ee8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d852c0-321c-4874-9583-e8bd65864f69', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b61334-ad40-4850-8907-6bcbe2777a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:36 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 1073741824 Apr 14 03:07:36 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:36 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Volume volume-f4d852c0-321c-4874-9583-e8bd65864f69 (f4d852c0-321c-4874-9583-e8bd65864f69): created successfully Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b61334-ad40-4850-8907-6bcbe2777a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Flow 'volume_create_manager' (f3652fa1-3b21-41d7-bd85-8ede65ad2bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:36 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8d1f70f6-a6cb-4860-8aea-41cbd7fd95f7 tempest-CreateVolumesFromImageTest-118666478 None] Created volume successfully. Apr 14 03:07:36 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 1073741824" returned: 0 in 0.468s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:36 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 Apr 14 03:07:36 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-f4d852c0-321c-4874-9583-e8bd65864f69-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-f4d852c0-321c-4874-9583-e8bd65864f69-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-quobyte-f4d852c0-321c-4874-9583-e8bd65864f69" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-f4d852c0-321c-4874-9583-e8bd65864f69" acquired by "delete_volume" :: waited 0.006s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fd5cc7-30af-419a-84e7-6c59fea11263]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:36 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:37 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 Apr 14 03:07:37 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:37 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.902s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-433465071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8fd5bbf-d2c7-483a-a31a-424b6d74df08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:31Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Creating volume b8fd5bbf-d2c7-483a-a31a-424b6d74df08 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:37 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf86f3f-967f-4f81-9fa3-1d4fc5aaf22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd3618a-a077-4b9b-89a7-7b93bccfc127', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99040f0b-61d5-4cd4-a8a3-ca0c77f785ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:37 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 1073741824 Apr 14 03:07:37 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:37 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 (edd3618a-a077-4b9b-89a7-7b93bccfc127): created successfully Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99040f0b-61d5-4cd4-a8a3-ca0c77f785ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (ec8cd45f-a2c8-4c39-9d41-fb690d4844fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:37 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ce4e1590-14f7-46f1-b968-5569047883a7 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created volume successfully. Apr 14 03:07:37 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69" returned: 0 in 0.502s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:37 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69 Apr 14 03:07:37 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:37 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 1073741824" returned: 0 in 0.471s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:37 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 Apr 14 03:07:37 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:37 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f4d852c0-321c-4874-9583-e8bd65864f69" returned: 0 in 0.422s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-f4d852c0-321c-4874-9583-e8bd65864f69" released by "delete_volume" :: held 0.943s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Created reservations ['37719e82-71c5-4b7c-995c-7d0cc6dd8a09', '7b474b18-4bc5-4d2e-a655-bb401c8b891e', '330ceda9-c904-4e6f-a90f-4150a1ab15e5', 'c3d49f64-10cf-4981-8ff9-f25419ede391'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:37 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:37 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:37 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-53d411fb-91fc-4c4c-b81d-550ffed2405c-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:38 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08" returned: 0 in 0.445s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-53d411fb-91fc-4c4c-b81d-550ffed2405c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.683s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-299186346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613bc9de-4f47-4151-979f-6074a78122db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:31Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Creating volume 613bc9de-4f47-4151-979f-6074a78122db {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:38 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6baf42a-a487-4540-b930-dca715674bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb7e6ef-76a4-465f-966d-a654b985c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:38 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db 1073741824 Apr 14 03:07:38 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:38 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 (b8fd5bbf-d2c7-483a-a31a-424b6d74df08): created successfully Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb7e6ef-76a4-465f-966d-a654b985c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (28e7b712-4d0e-4c85-9094-f98a11df7d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-quobyte-53d411fb-91fc-4c4c-b81d-550ffed2405c" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-279c9048-d2d4-4197-a10a-27146f46d8fc tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created volume successfully. Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-53d411fb-91fc-4c4c-b81d-550ffed2405c" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96f636b-8af0-4e9b-91d5-1a105a410dcf]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:38 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c Apr 14 03:07:38 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:38 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.453s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:38 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Deleted volume successfully. Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9abc0358-5a1b-48b5-810a-f4ae12a63ce5 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-f4d852c0-321c-4874-9583-e8bd65864f69-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:38 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db 1073741824" returned: 0 in 0.504s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:38 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db Apr 14 03:07:38 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:38 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c" returned: 0 in 0.515s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:38 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:38 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c Apr 14 03:07:38 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:38 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db" returned: 0 in 0.401s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.442s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1477085499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:31Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Creating volume 14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:39 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec2ef3f-a2f3-4141-b7d2-3d00853382ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613bc9de-4f47-4151-979f-6074a78122db', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4503a2da-a08e-48d8-8922-93f60ea7c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:39 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e 1073741824 Apr 14 03:07:39 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume volume-613bc9de-4f47-4151-979f-6074a78122db (613bc9de-4f47-4151-979f-6074a78122db): created successfully Apr 14 03:07:39 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4503a2da-a08e-48d8-8922-93f60ea7c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (3317e9a3-18f1-4e7a-992c-ec5f9266d225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:39 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-bf0340e3-d791-451f-9020-0854d9dcff45 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created volume successfully. Apr 14 03:07:39 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-53d411fb-91fc-4c4c-b81d-550ffed2405c" returned: 0 in 0.421s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-53d411fb-91fc-4c4c-b81d-550ffed2405c" released by "delete_volume" :: held 0.957s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Created reservations ['35042bf3-29e0-4bc3-b446-e80f5df19b93', 'd8496684-17f2-4396-a2dd-bbf72c54c047', '3307dc09-4db4-4b41-ad05-7b6f540e49c7', '84f10484-9453-4f8b-9dbd-17388d812e3e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:39 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:39 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:39 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e 1073741824" returned: 0 in 0.525s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:39 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e Apr 14 03:07:39 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:39 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.413s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:39 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Deleted volume successfully. Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9e8011e5-953a-4e99-a089-53c7cce3f339 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-53d411fb-91fc-4c4c-b81d-550ffed2405c-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:39 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e" returned: 0 in 0.408s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.187s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1719014637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a33547f-983f-4048-bdb3-00f996dc03fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a84e2f6d5564e649d6bdc43d25cbad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:32Z,use_quota=True,user_id='d2bc27ffa385420fb081d7a483047f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Creating volume 2a33547f-983f-4048-bdb3-00f996dc03fc {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:39 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2178d19-6b80-4895-a236-ad7b8ba25003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:39 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d349899-f4db-4715-8318-9dfff8c86691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:39 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc 1073741824 Apr 14 03:07:39 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:40 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e (14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e): created successfully Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d349899-f4db-4715-8318-9dfff8c86691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (ff4e4a4e-4396-452e-9a3e-3f1e16542c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:40 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-dbe61558-4881-4802-acf8-2066ebb4e1ab tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created volume successfully. Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-04148dff-0ca3-487a-9648-eaec21118c8b-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-04148dff-0ca3-487a-9648-eaec21118c8b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-quobyte-04148dff-0ca3-487a-9648-eaec21118c8b" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-04148dff-0ca3-487a-9648-eaec21118c8b" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b76d266-8a3d-40bc-a5b8-2dadb216c96b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:40 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b Apr 14 03:07:40 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:40 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc 1073741824" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:40 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc Apr 14 03:07:40 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:40 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b" returned: 0 in 0.474s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:40 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b Apr 14 03:07:40 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:40 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc" returned: 0 in 0.410s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.988s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422f1ce1-4021-4079-bd5e-a5b9940d06e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a33547f-983f-4048-bdb3-00f996dc03fc', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4f1974-f582-4b99-ae14-2106170273a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Creating offline snapshot 9d68cec6-449d-4731-9f14-4c84d87aba5d of volume 86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:07:40 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Volume volume-2a33547f-983f-4048-bdb3-00f996dc03fc (2a33547f-983f-4048-bdb3-00f996dc03fc): created successfully Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4f1974-f582-4b99-ae14-2106170273a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Flow 'volume_create_manager' (d4f06c22-2010-4034-bedc-80d85b470354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d2b31-232f-4f20-aae4-58f414e9a8af]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:40 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:40 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-88348877-4ee2-46c9-bd69-68b188068cb6 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created volume successfully. Apr 14 03:07:41 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb Apr 14 03:07:41 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:41 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-04148dff-0ca3-487a-9648-eaec21118c8b" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-04148dff-0ca3-487a-9648-eaec21118c8b" released by "delete_volume" :: held 0.936s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Created reservations ['911fdb3b-9429-4a2d-93a8-2a2d6a18bd5b', 'de9f04f4-23c8-456a-b38d-b4402a1171aa', 'be14a5c4-cafe-47fd-a098-6609b36f4382', 'edf4d399-a53c-45ef-a018-f9100cc021ad'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:41 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:41 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-bb90f2f1-ef67-441b-ba2b-cc84e94ba768-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-bb90f2f1-ef67-441b-ba2b-cc84e94ba768-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-quobyte-bb90f2f1-ef67-441b-ba2b-cc84e94ba768" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-bb90f2f1-ef67-441b-ba2b-cc84e94ba768" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-2a33547f-983f-4048-bdb3-00f996dc03fc-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84964e-5706-440c-99a7-5f7a00274169]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-2a33547f-983f-4048-bdb3-00f996dc03fc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-quobyte-2a33547f-983f-4048-bdb3-00f996dc03fc" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:41 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb" returned: 0 in 0.534s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-2a33547f-983f-4048-bdb3-00f996dc03fc" acquired by "delete_volume" :: waited 0.022s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:41 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 Apr 14 03:07:41 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:41 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d 1G Apr 14 03:07:41 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a52712-30a8-4e21-b52d-0cc5abb51765]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:41 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc Apr 14 03:07:41 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:41 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.530s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:41 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Deleted volume successfully. Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a69f065f-c75f-4920-ac66-b936a043e90e tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-04148dff-0ca3-487a-9648-eaec21118c8b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:41 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768" returned: 0 in 0.503s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:41 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768 Apr 14 03:07:41 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:41 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d 1G" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:41 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:41 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d Apr 14 03:07:41 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:42 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc" returned: 0 in 0.526s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:42 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc Apr 14 03:07:42 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:42 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-bb90f2f1-ef67-441b-ba2b-cc84e94ba768" returned: 0 in 0.450s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-bb90f2f1-ef67-441b-ba2b-cc84e94ba768" released by "delete_volume" :: held 0.981s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:42 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d" returned: 0 in 0.431s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:42 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d is being set with open permissions: ugo+rw Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:42 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d Apr 14 03:07:42 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Created reservations ['32d3f90d-17ce-4c9b-99ea-cd8e7a21eb9a', '38e20a95-1241-4d16-99c5-55ec4669e0f9', '94ba6724-80e1-4e81-9dcf-94322fcc0105', '5d2aca22-6abc-4275-9eb4-2f8b39f7577a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:42 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a33547f-983f-4048-bdb3-00f996dc03fc" returned: 0 in 0.459s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-2a33547f-983f-4048-bdb3-00f996dc03fc" released by "delete_volume" :: held 1.016s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:42 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:42 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created reservations ['072577d9-ff5e-4d2c-be8e-150dbdfe3059', '7dfbda37-0716-4ad0-a1d7-1df1a4b35498', 'b248510a-c2de-4c6e-848d-61ccbe3bd468', '79d527da-e4a4-41f9-a0d5-d4b88d013ca7'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:42 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:42 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:42 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d" returned: 0 in 0.430s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:42 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.info Apr 14 03:07:42 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:42 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.435s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:42 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Deleted volume successfully. Apr 14 03:07:42 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f3e5b0e0-8bc1-4a38-95df-7f677c207308 tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-bb90f2f1-ef67-441b-ba2b-cc84e94ba768-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:43 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.421s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:43 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Deleted volume successfully. Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-84040d4f-285b-4fd2-84a3-c540bd30b27f tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-2a33547f-983f-4048-bdb3-00f996dc03fc-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:43 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.info" returned: 0 in 0.421s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:43 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.info is being set with open permissions: ugo+rw Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:43 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.info Apr 14 03:07:43 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-fd04805c-46f5-405a-a78d-08d279c0df9a-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-fd04805c-46f5-405a-a78d-08d279c0df9a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "cinder-quobyte-fd04805c-46f5-405a-a78d-08d279c0df9a" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-fd04805c-46f5-405a-a78d-08d279c0df9a" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af1b8af-a0e3-44db-90a8-9e74ded6c1ce]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-quobyte-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9610e8-8935-424f-9fba-1e263e0c3fb3]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:43 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a Apr 14 03:07:43 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:43 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e Apr 14 03:07:43 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:43 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.info" returned: 0 in 0.470s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.861s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.742s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:43 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6ccb7f87-cf9f-4abd-b584-d679c559e284 tempest-VolumeDependencyTests-2099042358 None] Create snapshot completed successfully Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Creating offline snapshot 620df52c-7751-4f37-b9af-61604d0111f7 of volume b05ac433-bcb8-4cca-b5c3-353eb5282b66 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[334069e5-1ab6-42ee-a2b0-db478d72fc9e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:43 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:43 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 Apr 14 03:07:43 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:44 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a" returned: 0 in 0.519s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:44 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a Apr 14 03:07:44 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:44 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e" returned: 0 in 0.485s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:44 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e Apr 14 03:07:44 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:44 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66" returned: 0 in 0.488s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:44 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 1G Apr 14 03:07:44 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Flow 'volume_create_manager' (1fa98b53-8ef6-4b1b-9950-48218f55a4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c16028-2442-4cbf-889f-06e21a21f9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:44 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:44 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c16028-2442-4cbf-889f-06e21a21f9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1480104160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368b1bf8-2baf-42b5-9cde-ee68a5e5752b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f11e06ce0b46cf80a542b13602a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d68cec6-449d-4731-9f14-4c84d87aba5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:45Z,use_quota=True,user_id='589d33b375634f23a5d1deb2072a6de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3346a94-8827-4383-a4f4-d7d72a8fe243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3346a94-8827-4383-a4f4-d7d72a8fe243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f96579-42f8-4e31-974e-574cc05dc2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f96579-42f8-4e31-974e-574cc05dc2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '368b1bf8-2baf-42b5-9cde-ee68a5e5752b', 'volume_name': 'volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b', 'volume_size': 1, 'snapshot_id': '9d68cec6-449d-4731-9f14-4c84d87aba5d'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4d5aeb-a9a0-427b-9428-4ec7d5ae78b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4d5aeb-a9a0-427b-9428-4ec7d5ae78b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5a6da2-3c7c-4187-8169-88566f3db5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:44 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Volume 368b1bf8-2baf-42b5-9cde-ee68a5e5752b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b', 'volume_size': 1, 'snapshot_id': '9d68cec6-449d-4731-9f14-4c84d87aba5d'} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e" returned: 0 in 0.525s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-fd04805c-46f5-405a-a78d-08d279c0df9a" returned: 0 in 0.567s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e" released by "delete_volume" :: held 1.039s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-quobyte-fd04805c-46f5-405a-a78d-08d279c0df9a" released by "delete_volume" :: held 1.115s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Created reservations ['9568f348-267d-47f7-a7c1-04442b8aa6d5', 'ec2d2f66-216c-4daa-a0ee-98233108091b', 'e691e33d-b5b6-466a-9fd5-8e8b27a4e3b9', 'cb527b15-5b0d-4ebb-a906-6e0aa0cb8ebe'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created reservations ['04edd544-cd81-484c-8ee2-d35510b4f74f', 'bf523d54-7ff5-47b9-8087-c7b36872161e', '0dc71237-55e8-4829-80c5-57951d050525', 'a253ba73-ea87-46a0-b5bc-55cf3453508c'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:44 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:44 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:44 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:44 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:44 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 1G" returned: 0 in 0.600s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:44 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:44 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 Apr 14 03:07:44 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:45 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.402s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:45 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Deleted volume successfully. Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-f600bcd6-aa49-48f5-a2b5-590eae71ed3a tempest-CreateVolumesFromImageTest-118666478 None] Lock "cinder-fd04805c-46f5-405a-a78d-08d279c0df9a-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:45 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.408s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:45 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Deleted volume successfully. Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6ba6bcae-c8e3-4f8d-94a7-dd95b4403b58 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-14f0c79c-0e11-4d65-a07a-fc03ea9e5d3e-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:45 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7" returned: 0 in 0.448s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:45 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 is being set with open permissions: ugo+rw Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:45 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 Apr 14 03:07:45 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:45 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7" returned: 0 in 0.401s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-613bc9de-4f47-4151-979f-6074a78122db-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:45 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.info Apr 14 03:07:45 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-613bc9de-4f47-4151-979f-6074a78122db-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-quobyte-613bc9de-4f47-4151-979f-6074a78122db" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-613bc9de-4f47-4151-979f-6074a78122db" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b1323b-cdb4-4fd5-ab69-04a4c40dc916]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:45 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:45 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db Apr 14 03:07:45 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:46 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.info" returned: 0 in 0.499s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:46 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.info is being set with open permissions: ugo+rw Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:46 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.info Apr 14 03:07:46 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:46 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db" returned: 0 in 0.542s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:46 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db Apr 14 03:07:46 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:46 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.info" returned: 0 in 0.513s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.100s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-9d68cec6-449d-4731-9f14-4c84d87aba5d-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" by "_create_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-9d68cec6-449d-4731-9f14-4c84d87aba5d-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Creating volume 368b1bf8-2baf-42b5-9cde-ee68a5e5752b from snapshot 9d68cec6-449d-4731-9f14-4c84d87aba5d {{(pid=82473) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:46 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8e4daf99-2e6f-4463-9c73-7a22cdb1177e tempest-CreateVolumesFromSnapshotTest-114362163 None] Create snapshot completed successfully Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] snapshot: 9d68cec6-449d-4731-9f14-4c84d87aba5d, volume: 368b1bf8-2baf-42b5-9cde-ee68a5e5752b, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[feda2d59-1921-44fa-8b4f-07c9990888eb]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:46 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-613bc9de-4f47-4151-979f-6074a78122db" returned: 0 in 0.519s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-613bc9de-4f47-4151-979f-6074a78122db" released by "delete_volume" :: held 1.093s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created reservations ['1eee0add-a6c0-486a-9525-2d759d692d0e', 'e9f3c88b-03c7-45cc-ac0c-d350996061b3', 'f6c7a2d5-99ea-4bf2-8da8-b8ab368d00ec', 'cccbacc2-91c5-4da9-8e85-0f0c260cefec'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:46 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:46 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d Apr 14 03:07:46 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:47 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:47 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:47 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d" returned: 0 in 0.590s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2a1fdd-6e49-4562-a9cd-eeb000bd0bf2]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:47 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.512s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:47 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Deleted volume successfully. Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a02b3951-a2b0-4c3e-acfd-c9e1ef85b1e8 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-613bc9de-4f47-4151-979f-6074a78122db-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:47 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb Apr 14 03:07:47 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (82ffef22-a119-48d3-b94a-298f962a98a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a31107-d5ed-4062-a82a-cbf9ea8fbdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a31107-d5ed-4062-a82a-cbf9ea8fbdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590189802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2482b100-60cb-49fb-9731-55b61363285b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:48Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599d79c8-14f0-4d4e-8b2a-20f06255dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599d79c8-14f0-4d4e-8b2a-20f06255dced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f484bf5f-926e-4eb0-a0c0-57164faeb5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f484bf5f-926e-4eb0-a0c0-57164faeb5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2482b100-60cb-49fb-9731-55b61363285b', 'volume_name': 'volume-2482b100-60cb-49fb-9731-55b61363285b', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84996e6b-9e2f-498a-9044-e3cb6d50c6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84996e6b-9e2f-498a-9044-e3cb6d50c6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6cec02-854d-454d-81c2-d6d111abec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume 2482b100-60cb-49fb-9731-55b61363285b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2482b100-60cb-49fb-9731-55b61363285b', 'volume_size': 1} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (113babe5-6704-4321-b89c-8137f769ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeee11bc-3239-4ebc-86a1-50e1866d3f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeee11bc-3239-4ebc-86a1-50e1866d3f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753244683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66dfe8b-3333-46f7-a6c6-ceccf78901dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:48Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96dba79b-58a5-4af8-87e0-f4b50eef258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96dba79b-58a5-4af8-87e0-f4b50eef258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb6dc77-972c-4713-b142-35f7609fd334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb6dc77-972c-4713-b142-35f7609fd334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f66dfe8b-3333-46f7-a6c6-ceccf78901dc', 'volume_name': 'volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25ffc58-4b35-4e82-a879-0b17640c5567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25ffc58-4b35-4e82-a879-0b17640c5567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965deae9-cf55-492d-9e3c-2f71151a7255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:47 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume f66dfe8b-3333-46f7-a6c6-ceccf78901dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc', 'volume_size': 1} Apr 14 03:07:47 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-b8fd5bbf-d2c7-483a-a31a-424b6d74df08-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-b8fd5bbf-d2c7-483a-a31a-424b6d74df08-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-quobyte-b8fd5bbf-d2c7-483a-a31a-424b6d74df08" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-b8fd5bbf-d2c7-483a-a31a-424b6d74df08" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[1749753e-4a8a-4a44-b857-1183dc69e183]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:48 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 Apr 14 03:07:48 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (9f12cacd-363f-4750-9e17-48a8be669c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0be8832-449d-4dfe-838a-200b69439560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0be8832-449d-4dfe-838a-200b69439560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425510373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86216fe-dadc-4aae-bb85-8242c0f9d551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:48Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0cda16-4973-4ae7-97f7-d3d44096bed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0cda16-4973-4ae7-97f7-d3d44096bed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf327e68-985d-4099-bf74-5c9758f65ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf327e68-985d-4099-bf74-5c9758f65ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f86216fe-dadc-4aae-bb85-8242c0f9d551', 'volume_name': 'volume-f86216fe-dadc-4aae-bb85-8242c0f9d551', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d611d0-aa80-43b4-9509-2078be9a8970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d611d0-aa80-43b4-9509-2078be9a8970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e2deb3-a808-48a8-aeef-37e01fc13a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume f86216fe-dadc-4aae-bb85-8242c0f9d551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f86216fe-dadc-4aae-bb85-8242c0f9d551', 'volume_size': 1} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb" returned: 0 in 0.809s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:48 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b Apr 14 03:07:48 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (23308d13-e07b-4d2d-bb28-465cd9c6aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4998bb1-97fd-4e09-8d36-cb3670c882d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4998bb1-97fd-4e09-8d36-cb3670c882d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388211729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:48Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23aedb7-a094-4370-8947-8aac85b2de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23aedb7-a094-4370-8947-8aac85b2de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ffe6dc-db82-45c4-b16a-cc7c0ad27e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ffe6dc-db82-45c4-b16a-cc7c0ad27e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3', 'volume_name': 'volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd610954-c3c7-4a76-9646-689eefdd117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd610954-c3c7-4a76-9646-689eefdd117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7cd35c-3e82-4593-829c-4dd5f195cafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3', 'volume_size': 1} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:48 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08" returned: 0 in 0.688s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:48 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08 Apr 14 03:07:48 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (f69f0b84-93fa-44f6-8fa5-eec87d1079bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8206aa-7f7e-47a0-83a3-208e10649193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8206aa-7f7e-47a0-83a3-208e10649193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1924114464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:49Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afbf7f4-8638-4549-84bd-58e76139d5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afbf7f4-8638-4549-84bd-58e76139d5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8061dc18-7966-4657-99c4-ab78f90fa387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8061dc18-7966-4657-99c4-ab78f90fa387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4', 'volume_name': 'volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c48e3e-ce94-4ff2-a58f-48a287afcf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c48e3e-ce94-4ff2-a58f-48a287afcf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed3c6d1-41ea-462b-9333-037c74e7ffbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:48 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4', 'volume_size': 1} Apr 14 03:07:48 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:49 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b8fd5bbf-d2c7-483a-a31a-424b6d74df08" returned: 0 in 0.630s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-b8fd5bbf-d2c7-483a-a31a-424b6d74df08" released by "delete_volume" :: held 1.349s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created reservations ['4e03ec8f-3146-4a59-9192-a33687f3e893', '99dfd61b-21a3-4e2a-a755-90d4031b2b07', '2d8c3743-7670-421e-9248-ccefa354e1a8', 'c51e4a87-84bb-4349-99f6-6c2e8c81ca8a'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:49 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:49 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:49 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-edd3618a-a077-4b9b-89a7-7b93bccfc127-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-edd3618a-a077-4b9b-89a7-7b93bccfc127-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-quobyte-edd3618a-a077-4b9b-89a7-7b93bccfc127" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-edd3618a-a077-4b9b-89a7-7b93bccfc127" acquired by "delete_volume" :: waited 0.041s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ebcdf-c5e7-4178-a44f-b2b8baff33f1]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:50 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" returned: 0 in 2.437s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eb6941-1c39-4118-a2ce-d320d72e187a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:50 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 Apr 14 03:07:50 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:50 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb Apr 14 03:07:50 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:50 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 1.225s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:50 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Deleted volume successfully. Apr 14 03:07:50 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-521187ce-0c83-4c66-b31b-e63fa8bbd3f2 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-b8fd5bbf-d2c7-483a-a31a-424b6d74df08-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:51 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127" returned: 0 in 0.543s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:51 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127 Apr 14 03:07:51 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:51 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb" returned: 0 in 0.700s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:07:51 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Converted 1024.00 MB image at 419.94 MB/s Apr 14 03:07:51 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b is being set with open permissions: ugo+rw Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:51 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b Apr 14 03:07:51 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:51 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-edd3618a-a077-4b9b-89a7-7b93bccfc127" returned: 0 in 0.446s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-edd3618a-a077-4b9b-89a7-7b93bccfc127" released by "delete_volume" :: held 1.048s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created reservations ['1e4851dd-2b28-470e-9710-fc464a562216', '7f0edf61-ba0d-446b-91c1-2486a23da49a', 'a7f4b339-c153-44f4-be18-9c846ae39c05', '23eb3f85-922a-47c2-8ee8-6bef5845f3df'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:51 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:51 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:51 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" returned: 0 in 0.436s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" released by "_copy_volume_from_snapshot" :: held 5.047s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-9d68cec6-449d-4731-9f14-4c84d87aba5d-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" released by "_create_volume_from_snapshot" :: held 5.080s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.100s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.159s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590189802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2482b100-60cb-49fb-9731-55b61363285b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:48Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Creating volume 2482b100-60cb-49fb-9731-55b61363285b {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:51 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:51 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b 1073741824 Apr 14 03:07:51 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5a6da2-3c7c-4187-8169-88566f3db5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b', 'volume_size': 1, 'snapshot_id': '9d68cec6-449d-4731-9f14-4c84d87aba5d'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c8c5e7-9612-4f8f-bc16-3ddbd666695b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:51 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Volume volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b (368b1bf8-2baf-42b5-9cde-ee68a5e5752b): created successfully Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c8c5e7-9612-4f8f-bc16-3ddbd666695b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:51 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Flow 'volume_create_manager' (1fa98b53-8ef6-4b1b-9950-48218f55a4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:51 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-1339be12-9e87-4ab1-9d26-770aecba6632 tempest-VolumeDependencyTests-2099042358 None] Created volume successfully. Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-9d68cec6-449d-4731-9f14-4c84d87aba5d-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-9d68cec6-449d-4731-9f14-4c84d87aba5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-86c01976-94ba-4a27-bc0a-806c2c51fdcb" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-86c01976-94ba-4a27-bc0a-806c2c51fdcb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-9d68cec6-449d-4731-9f14-4c84d87aba5d" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-9d68cec6-449d-4731-9f14-4c84d87aba5d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Deleting offline snapshot 9d68cec6-449d-4731-9f14-4c84d87aba5d of volume 86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] snapshot_file for this snap is: volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7993c4e-bf75-4eb2-a2e4-d0a3f20ee0bb]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:52 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d Apr 14 03:07:52 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:52 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.619s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:52 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Deleted volume successfully. Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8ba72a7d-fdb2-421d-9de0-0481e142d0d4 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-edd3618a-a077-4b9b-89a7-7b93bccfc127-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:52 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b 1073741824" returned: 0 in 0.785s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:52 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d" returned: 0 in 0.516s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:07:52 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b Apr 14 03:07:52 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3833af6c-91c2-4154-844a-f566eba8fa3e]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-32caf73e-da26-4126-a82d-475a5e89e04f-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-32caf73e-da26-4126-a82d-475a5e89e04f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:52 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb Apr 14 03:07:52 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "cinder-quobyte-32caf73e-da26-4126-a82d-475a5e89e04f" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-32caf73e-da26-4126-a82d-475a5e89e04f" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f5eac0-c425-49aa-bbc1-3394b18c2abf]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:52 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:53 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f Apr 14 03:07:53 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:53 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b" returned: 0 in 0.562s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.306s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753244683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66dfe8b-3333-46f7-a6c6-ceccf78901dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:48Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Creating volume f66dfe8b-3333-46f7-a6c6-ceccf78901dc {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:53 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6cec02-854d-454d-81c2-d6d111abec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2482b100-60cb-49fb-9731-55b61363285b', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c71c0d-07b3-4c4e-9b8c-47e1894da4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:53 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc 1073741824 Apr 14 03:07:53 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:53 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb" returned: 0 in 0.573s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:53 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume volume-2482b100-60cb-49fb-9731-55b61363285b (2482b100-60cb-49fb-9731-55b61363285b): created successfully Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c71c0d-07b3-4c4e-9b8c-47e1894da4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (82ffef22-a119-48d3-b94a-298f962a98a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:53 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-506613b6-9835-4594-8b3f-d74e4e1cdf66 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created volume successfully. Apr 14 03:07:53 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d Apr 14 03:07:53 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:53 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f" returned: 0 in 0.583s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:53 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f Apr 14 03:07:53 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:53 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc 1073741824" returned: 0 in 0.578s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:53 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d" returned: 0 in 0.586s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:53 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:53 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc Apr 14 03:07:53 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:53 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d Apr 14 03:07:53 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:53 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-32caf73e-da26-4126-a82d-475a5e89e04f" returned: 0 in 0.497s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-quobyte-32caf73e-da26-4126-a82d-475a5e89e04f" released by "delete_volume" :: held 1.107s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Created reservations ['496e4bcc-32a4-424e-b851-b4e3f68e3bec', '939121a8-5cfb-411c-be06-15e8550a6bcd', '8b9a55be-378f-4f40-aa7f-2b9ea75892d2', 'e665584a-5999-4a45-9649-7a847fd70dfb'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:54 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:54 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:54 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb.9d68cec6-449d-4731-9f14-4c84d87aba5d" returned: 0 in 0.561s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-9d68cec6-449d-4731-9f14-4c84d87aba5d" released by "_delete_snapshot" :: held 2.345s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-86c01976-94ba-4a27-bc0a-806c2c51fdcb" released by "delete_snapshot" :: held 2.367s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Created reservations ['7a05e854-5bfb-4abb-97a1-55d97cdb6c3e', '66bc02a9-400b-4ddd-b707-13c30a96a8e6', '08c7519f-b191-441c-91ae-7ea1b31041bf', '9e53e509-095f-4427-9863-cdb4355e82ec'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:54 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc" returned: 0 in 0.725s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.354s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425510373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86216fe-dadc-4aae-bb85-8242c0f9d551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:48Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Creating volume f86216fe-dadc-4aae-bb85-8242c0f9d551 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:54 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965deae9-cf55-492d-9e3c-2f71151a7255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94be60c0-352e-4ac1-9acf-816b7b3c05fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:54 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 1073741824 Apr 14 03:07:54 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:54 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc (f66dfe8b-3333-46f7-a6c6-ceccf78901dc): created successfully Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94be60c0-352e-4ac1-9acf-816b7b3c05fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (113babe5-6704-4321-b89c-8137f769ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:54 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d9a0d4b8-8f14-473d-801b-f700d701e3ac tempest-CreateVolumesFromSnapshotTest-114362163 None] Created volume successfully. Apr 14 03:07:54 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Delete snapshot completed successfully. Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-cdc52094-efd4-4c7d-a520-17cd34980154 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-9d68cec6-449d-4731-9f14-4c84d87aba5d-delete_snapshot" released by "delete_snapshot" :: held 2.567s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:54 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.745s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:54 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Deleted volume successfully. Apr 14 03:07:54 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9f35ebad-dc36-4696-a452-ef6e50840819 tempest-CreateVolumesFromSourceVolumeTest-718105716 None] Lock "cinder-32caf73e-da26-4126-a82d-475a5e89e04f-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:55 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 1073741824" returned: 0 in 0.622s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:55 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 Apr 14 03:07:55 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-86c01976-94ba-4a27-bc0a-806c2c51fdcb-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-86c01976-94ba-4a27-bc0a-806c2c51fdcb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-86c01976-94ba-4a27-bc0a-806c2c51fdcb" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-86c01976-94ba-4a27-bc0a-806c2c51fdcb" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[381fe973-d8f7-46f8-a242-42465b6cfc94]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:55 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb Apr 14 03:07:55 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:55 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551" returned: 0 in 0.583s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.292s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388211729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:48Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Creating volume f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:55 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e2deb3-a808-48a8-aeef-37e01fc13a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86216fe-dadc-4aae-bb85-8242c0f9d551', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:55 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 1073741824 Apr 14 03:07:55 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a1dec8-a309-4aff-b5d7-9f9814ada4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:55 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 (f86216fe-dadc-4aae-bb85-8242c0f9d551): created successfully Apr 14 03:07:55 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a1dec8-a309-4aff-b5d7-9f9814ada4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (9f12cacd-363f-4750-9e17-48a8be669c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:56 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-4eba36e6-c377-4fb6-94e0-d0c4db649785 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created volume successfully. Apr 14 03:07:56 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb" returned: 0 in 0.581s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:56 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb Apr 14 03:07:56 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:56 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 1073741824" returned: 0 in 0.623s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:56 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 Apr 14 03:07:56 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:56 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-86c01976-94ba-4a27-bc0a-806c2c51fdcb" returned: 0 in 0.591s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-86c01976-94ba-4a27-bc0a-806c2c51fdcb" released by "delete_volume" :: held 1.225s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Created reservations ['df16dbb5-7a13-4c26-829d-8145f6055e47', '14c3bdda-f9c1-452a-ab71-a6120f03451b', '1755b35f-5052-4816-ac8f-4c1ba6cbe962', 'e59ea7f6-7f83-4828-b9e5-c6c8eac8682f'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:56 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:56 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:56 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:57 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3" returned: 0 in 0.516s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.217s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1924114464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda95f0b1bf142ecab2ad1946a41de84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:49Z,use_quota=True,user_id='dd1b313e5769423888dbc65d211a087b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Creating volume dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:57 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7cd35c-3e82-4593-829c-4dd5f195cafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318181b4-95e2-4bca-9b59-2a4eae3caf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:57 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 (f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3): created successfully Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318181b4-95e2-4bca-9b59-2a4eae3caf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:57 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 1073741824 Apr 14 03:07:57 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (23308d13-e07b-4d2d-bb28-465cd9c6aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-caa6cde9-c117-458d-9b3e-9f961dff8bff tempest-CreateVolumesFromSnapshotTest-114362163 None] Created volume successfully. Apr 14 03:07:57 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.506s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:07:57 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Deleted volume successfully. Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-2137abb0-b27d-437a-a523-c91f899c766b tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-86c01976-94ba-4a27-bc0a-806c2c51fdcb-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:57 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 1073741824" returned: 0 in 0.637s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:57 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 Apr 14 03:07:57 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Flow 'volume_create_manager' (a7b32270-10ed-4be1-88a9-e56907b2e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c1d164-b480-405e-b97a-b8957ae21582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c1d164-b480-405e-b97a-b8957ae21582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-567287418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a526619-7a63-433e-8956-e02793a69512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f11e06ce0b46cf80a542b13602a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:58Z,use_quota=True,user_id='589d33b375634f23a5d1deb2072a6de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9e189d-049d-4e60-82bb-36ebe32a6b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9e189d-049d-4e60-82bb-36ebe32a6b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ba72e2-3bfd-4f6b-ba8b-51a0647a7d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ba72e2-3bfd-4f6b-ba8b-51a0647a7d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a526619-7a63-433e-8956-e02793a69512', 'volume_name': 'volume-4a526619-7a63-433e-8956-e02793a69512', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265afdef-82f1-49ea-9a8d-d2e281336740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265afdef-82f1-49ea-9a8d-d2e281336740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b64b45-2da0-4f01-996f-afd7280ccc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:57 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Volume 4a526619-7a63-433e-8956-e02793a69512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a526619-7a63-433e-8956-e02793a69512', 'volume_size': 1} Apr 14 03:07:57 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:58 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4" returned: 0 in 0.495s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-567287418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a526619-7a63-433e-8956-e02793a69512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f11e06ce0b46cf80a542b13602a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:07:58Z,use_quota=True,user_id='589d33b375634f23a5d1deb2072a6de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Creating volume 4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:07:58 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ed3c6d1-41ea-462b-9333-037c74e7ffbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16780bac-540a-4eeb-bc58-89572fc9fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:58 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 1073741824 Apr 14 03:07:58 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:58 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Volume volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 (dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4): created successfully Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16780bac-540a-4eeb-bc58-89572fc9fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Flow 'volume_create_manager' (f69f0b84-93fa-44f6-8fa5-eec87d1079bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:58 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-24cd1360-4fd9-40f9-8f0c-524eba12ce59 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created volume successfully. Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-quobyte-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:07:58 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 1073741824" returned: 0 in 0.617s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1603fb7-4fea-4dfe-8394-a84b01c9bd4a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:58 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:58 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 Apr 14 03:07:58 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:58 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 Apr 14 03:07:58 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:59 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512" returned: 0 in 0.464s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b64b45-2da0-4f01-996f-afd7280ccc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a526619-7a63-433e-8956-e02793a69512', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:59 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae012a7-5611-46ff-9293-63633e366d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4" returned: 0 in 0.505s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:59 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Volume volume-4a526619-7a63-433e-8956-e02793a69512 (4a526619-7a63-433e-8956-e02793a69512): created successfully Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae012a7-5611-46ff-9293-63633e366d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:07:59 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4 Apr 14 03:07:59 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Flow 'volume_create_manager' (a7b32270-10ed-4be1-88a9-e56907b2e827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:07:59 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-48a141cd-13b2-4ba2-8509-ca8210fb85e8 tempest-VolumeDependencyTests-2099042358 None] Created volume successfully. Apr 14 03:07:59 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4" returned: 0 in 0.445s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4" released by "delete_volume" :: held 0.987s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created reservations ['00d0d065-5355-4182-b619-acbc3b3d53f8', '2f3cd483-2919-4f6e-ab6a-b37f627f7c47', '54795d63-80be-4153-89db-21c8e9401851', '87183629-aa8f-4e8e-8ede-cba1bf2334b2'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:07:59 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:07:59 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:07:59 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Flow 'volume_create_manager' (89a812ea-8b48-4fd5-a34f-d6e62582c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d353a03c-645f-4ecd-a10b-ea3a9cae0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d353a03c-645f-4ecd-a10b-ea3a9cae0e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1231095161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3697b1e-2303-48a9-be80-e30374695742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05f11e06ce0b46cf80a542b13602a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4a526619-7a63-433e-8956-e02793a69512,status='creating',terminated_at=None,updated_at=2026-04-14T01:08:00Z,use_quota=True,user_id='589d33b375634f23a5d1deb2072a6de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7aabbef-c245-4eb8-a270-a5a099e65671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7aabbef-c245-4eb8-a270-a5a099e65671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e6ff1b-68fc-4ab1-a097-48f2a4e087ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e6ff1b-68fc-4ab1-a097-48f2a4e087ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a3697b1e-2303-48a9-be80-e30374695742', 'volume_name': 'volume-a3697b1e-2303-48a9-be80-e30374695742', 'volume_size': 1, 'source_volid': '4a526619-7a63-433e-8956-e02793a69512', 'source_volstatus': 'available'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda1d20a-71f9-4d2f-b326-4ec20ecc9cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda1d20a-71f9-4d2f-b326-4ec20ecc9cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc68f68-8915-4c21-b739-a11d89a097d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:00 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Volume a3697b1e-2303-48a9-be80-e30374695742: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a3697b1e-2303-48a9-be80-e30374695742', 'volume_size': 1, 'source_volid': '4a526619-7a63-433e-8956-e02793a69512', 'source_volstatus': 'available'} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:00 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Cloning volume 4a526619-7a63-433e-8956-e02793a69512 to volume a3697b1e-2303-48a9-be80-e30374695742 Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Creating offline snapshot 1bfefdad-8aff-4580-9506-f7412bd93781 of volume 4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[263c5347-3399-4a83-a059-e33162174bd0]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:00 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.491s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:00 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Deleted volume successfully. Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-8d0a4d4b-3857-4886-9b3e-2f340b790914 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-dab65fc5-d2cb-4f8d-a728-fcd94f60a8a4-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:00 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 Apr 14 03:08:00 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:00 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512" returned: 0 in 0.571s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:00 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:01 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 1G Apr 14 03:08:01 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-quobyte-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade0342d-4b8c-4709-a98d-1d04ed9c946b]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:01 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 Apr 14 03:08:01 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:01 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 1G" returned: 0 in 0.621s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a526619-7a63-433e-8956-e02793a69512 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:01 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a526619-7a63-433e-8956-e02793a69512 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 Apr 14 03:08:01 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:01 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3" returned: 0 in 0.592s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:01 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:01 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3 Apr 14 03:08:01 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:02 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a526619-7a63-433e-8956-e02793a69512 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:02 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 is being set with open permissions: ugo+rw Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:02 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 Apr 14 03:08:02 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:02 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3" returned: 0 in 0.470s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3" released by "delete_volume" :: held 1.086s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created reservations ['4c0cfd22-a4f2-40da-ada1-bd788060854a', '0435a10f-a327-4247-819a-0151ac557622', 'd6ea0f08-8492-4b4e-8598-7b8feaf1bcc8', '23ff0606-9a3a-4487-a8da-0e60dd194a94'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:02 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:02 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:02 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781" returned: 0 in 0.497s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:02 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.info Apr 14 03:08:02 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:02 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.450s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:02 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Deleted volume successfully. Apr 14 03:08:02 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-90c36d14-00ad-4b05-8b7f-58d62aa67617 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-f6cc377d-5e12-44ff-96b7-ad2bcfdfccc3-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:03 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.info" returned: 0 in 0.523s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:03 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.info is being set with open permissions: ugo+rw Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:03 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.info Apr 14 03:08:03 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-f86216fe-dadc-4aae-bb85-8242c0f9d551-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-f86216fe-dadc-4aae-bb85-8242c0f9d551-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-quobyte-f86216fe-dadc-4aae-bb85-8242c0f9d551" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-f86216fe-dadc-4aae-bb85-8242c0f9d551" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f54c51-be88-4f25-b5ea-684b11a04b86]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:03 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 Apr 14 03:08:03 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:03 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.info" returned: 0 in 0.541s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-a3697b1e-2303-48a9-be80-e30374695742" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-a3697b1e-2303-48a9-be80-e30374695742" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] snapshot: 1bfefdad-8aff-4580-9506-f7412bd93781, volume: a3697b1e-2303-48a9-be80-e30374695742, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef1ea24-a568-468b-8d2d-030e30e2adfe]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:03 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 Apr 14 03:08:03 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:03 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551" returned: 0 in 0.587s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:03 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:03 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551 Apr 14 03:08:03 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Flow 'volume_create_manager' (182cf6d1-ec2d-4e2f-9753-1ed4cf18b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46263562-2eb9-4dc9-af3a-c8edd814393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46263562-2eb9-4dc9-af3a-c8edd814393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-471588235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6391f8-570b-451d-a2e3-ccb3bdd33055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81eda3766130451e9e6719f793ccbb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:08:04Z,use_quota=True,user_id='11afd34323d24fae9077c50db3a71ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec0b410-d459-43a5-b507-f84ff7e8855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec0b410-d459-43a5-b507-f84ff7e8855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23825614-5833-482b-b65c-e74b339682f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23825614-5833-482b-b65c-e74b339682f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6391f8-570b-451d-a2e3-ccb3bdd33055', 'volume_name': 'volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b336c5f-0b39-4825-84b4-55a63bf6e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b336c5f-0b39-4825-84b4-55a63bf6e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f42a1-ca53-49ca-a93a-ae3a562b989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:04 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Volume 8f6391f8-570b-451d-a2e3-ccb3bdd33055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055', 'volume_size': 1} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:04 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781" returned: 0 in 0.507s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a526619-7a63-433e-8956-e02793a69512(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[c322e409-43e2-4555-b42d-6ee5df3b853d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:04 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f86216fe-dadc-4aae-bb85-8242c0f9d551" returned: 0 in 0.452s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-f86216fe-dadc-4aae-bb85-8242c0f9d551" released by "delete_volume" :: held 1.064s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:04 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 Apr 14 03:08:04 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Created reservations ['7a5b15c3-fd3e-4a9f-8bb7-4e71add2647e', '0ae90eac-7f09-434c-858c-5f87d6a7bb68', '6915232b-5a53-4408-8e33-8e6f7ee0e487', 'c6430de8-d37c-483e-86f6-8cfbf27c687f'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:04 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:04 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:04 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512" returned: 0 in 0.496s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:04 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 Apr 14 03:08:04 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:04 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.433s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:04 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Deleted volume successfully. Apr 14 03:08:04 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-b550056a-afe2-40f7-a750-1e1b2175e5cb tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-f86216fe-dadc-4aae-bb85-8242c0f9d551-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-f66dfe8b-3333-46f7-a6c6-ceccf78901dc-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-f66dfe8b-3333-46f7-a6c6-ceccf78901dc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-quobyte-f66dfe8b-3333-46f7-a6c6-ceccf78901dc" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:05 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-f66dfe8b-3333-46f7-a6c6-ceccf78901dc" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:05 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc798438-9367-468e-9291-cb38f82e4f9a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:05 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:05 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc Apr 14 03:08:05 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:06 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742" returned: 0 in 1.961s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:06 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba9d3d9-51b3-436d-a08d-f1530798046c]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:06 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc" returned: 0 in 1.231s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:06 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:06 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 Apr 14 03:08:06 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:06 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc Apr 14 03:08:06 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:07 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-f66dfe8b-3333-46f7-a6c6-ceccf78901dc" returned: 0 in 0.401s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-f66dfe8b-3333-46f7-a6c6-ceccf78901dc" released by "delete_volume" :: held 1.676s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Created reservations ['d55cdd7d-9e58-41ac-9aa6-0a49d49299f9', 'f437ef3e-d503-4d3d-afe2-4415e86865a0', 'd020a8ea-06e1-43f6-abb4-7a368d769622', '97bd8c5a-0f61-4c91-a4f7-b58ff2f3f47e'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:07 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:07 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:07 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512" returned: 0 in 0.601s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:08:07 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Converted 1024.00 MB image at 521.92 MB/s Apr 14 03:08:07 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 is being set with open permissions: ugo+rw Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:07 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 Apr 14 03:08:07 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-2482b100-60cb-49fb-9731-55b61363285b-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-2482b100-60cb-49fb-9731-55b61363285b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-quobyte-2482b100-60cb-49fb-9731-55b61363285b" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:07 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.440s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-2482b100-60cb-49fb-9731-55b61363285b" acquired by "delete_volume" :: waited 0.014s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:07 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742" returned: 0 in 0.429s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2219133-6ff0-4cef-874f-895d1dd887c7]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:07 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Deleted volume successfully. Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-a3697b1e-2303-48a9-be80-e30374695742" released by "_copy_volume_from_snapshot" :: held 4.062s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-1bfefdad-8aff-4580-9506-f7412bd93781" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-95e916a3-0dcf-43cf-9f9e-17de3e82edea tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-f66dfe8b-3333-46f7-a6c6-ceccf78901dc-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-1bfefdad-8aff-4580-9506-f7412bd93781" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Deleting offline snapshot 1bfefdad-8aff-4580-9506-f7412bd93781 of volume 4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] snapshot_file for this snap is: volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d68fd16-5e93-42f2-8239-999e170215cf]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:07 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:07 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b Apr 14 03:08:07 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:07 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 Apr 14 03:08:07 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:08 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:08 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b Apr 14 03:08:08 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:08 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a526619-7a63-433e-8956-e02793a69512(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[85617683-c7e8-4fff-8126-8f3cd7023ab8]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:08 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 Apr 14 03:08:08 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:08 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2482b100-60cb-49fb-9731-55b61363285b" returned: 0 in 0.425s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-2482b100-60cb-49fb-9731-55b61363285b" released by "delete_volume" :: held 0.933s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created reservations ['2d1badb7-a16a-4637-8206-e7c3c59af3a7', 'de704740-7558-4f85-a8d4-3de47304fc2c', '2ee1f201-272a-4fe2-9ce4-0f35680a6ff4', 'e179cf3b-9887-499f-8f84-9053bcd287cf'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:08 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:08 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-620df52c-7751-4f37-b9af-61604d0111f7-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-620df52c-7751-4f37-b9af-61604d0111f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-quobyte-b05ac433-bcb8-4cca-b5c3-353eb5282b66" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-b05ac433-bcb8-4cca-b5c3-353eb5282b66" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-quobyte-620df52c-7751-4f37-b9af-61604d0111f7" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-620df52c-7751-4f37-b9af-61604d0111f7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:08 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Deleting offline snapshot 620df52c-7751-4f37-b9af-61604d0111f7 of volume b05ac433-bcb8-4cca-b5c3-353eb5282b66 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] snapshot_file for this snap is: volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512" returned: 0 in 0.523s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[87977118-13e4-48aa-b443-b40d20dda953]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:08 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 Apr 14 03:08:08 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:08 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:08 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 Apr 14 03:08:08 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:09 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.496s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:09 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Deleted volume successfully. Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-7a279a41-db34-47f4-89e4-3ae48c2df633 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-2482b100-60cb-49fb-9731-55b61363285b-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:09 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781" returned: 0 in 0.483s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:09 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781 Apr 14 03:08:09 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:09 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7" returned: 0 in 0.542s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb459005-e328-47e4-b5b8-dce4d1766e9d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:09 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 Apr 14 03:08:09 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:09 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512.1bfefdad-8aff-4580-9506-f7412bd93781" returned: 0 in 0.421s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-1bfefdad-8aff-4580-9506-f7412bd93781" released by "_delete_snapshot" :: held 1.976s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.385s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.672s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-471588235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6391f8-570b-451d-a2e3-ccb3bdd33055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81eda3766130451e9e6719f793ccbb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:08:04Z,use_quota=True,user_id='11afd34323d24fae9077c50db3a71ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Creating volume 8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:08:09 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc68f68-8915-4c21-b739-a11d89a097d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3697b1e-2303-48a9-be80-e30374695742', 'volume_size': 1, 'source_volid': '4a526619-7a63-433e-8956-e02793a69512', 'source_volstatus': 'available'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7502a75a-f4fc-43d7-ba24-eeb8bfccc915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:09 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 1073741824 Apr 14 03:08:09 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:09 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Volume volume-a3697b1e-2303-48a9-be80-e30374695742 (a3697b1e-2303-48a9-be80-e30374695742): created successfully Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7502a75a-f4fc-43d7-ba24-eeb8bfccc915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Flow 'volume_create_manager' (89a812ea-8b48-4fd5-a34f-d6e62582c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:09 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6526b94e-83c7-4df0-98dc-3845f2afe642 tempest-VolumeDependencyTests-2099042358 None] Created volume successfully. Apr 14 03:08:09 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-4a526619-7a63-433e-8956-e02793a69512-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66" returned: 0 in 0.555s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-4a526619-7a63-433e-8956-e02793a69512-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:09 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 Apr 14 03:08:09 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:09 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-4a526619-7a63-433e-8956-e02793a69512" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-4a526619-7a63-433e-8956-e02793a69512" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a550f-750b-40b8-9096-d41e7695616d]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:10 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 Apr 14 03:08:10 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:10 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 1073741824" returned: 0 in 0.538s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:10 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 Apr 14 03:08:10 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:10 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7" returned: 0 in 0.453s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:10 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7 Apr 14 03:08:10 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:10 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512" returned: 0 in 0.518s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:10 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512 Apr 14 03:08:10 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:10 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055" returned: 0 in 0.409s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f42a1-ca53-49ca-a93a-ae3a562b989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4444ab-3ee3-4f55-a4b4-044f4ca1e618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:10 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Volume volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 (8f6391f8-570b-451d-a2e3-ccb3bdd33055): created successfully Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4444ab-3ee3-4f55-a4b4-044f4ca1e618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Flow 'volume_create_manager' (182cf6d1-ec2d-4e2f-9753-1ed4cf18b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:10 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-fd04f9ba-0a80-4af9-a3c7-bf16260564bf tempest-SnapshotDependencyTests-110681998 None] Created volume successfully. Apr 14 03:08:10 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66.620df52c-7751-4f37-b9af-61604d0111f7" returned: 0 in 0.419s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-620df52c-7751-4f37-b9af-61604d0111f7" released by "_delete_snapshot" :: held 2.059s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-b05ac433-bcb8-4cca-b5c3-353eb5282b66" released by "delete_snapshot" :: held 2.075s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created reservations ['84704d5d-d246-4b1d-a5eb-0339ad821715', 'd63371cb-edd7-4a40-a7c6-3bf0aed58210', 'c8c59d4f-9673-49ea-b527-88b7a8a2111b', '424ea090-2ed1-483c-bdb9-a761a5a4e165'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:10 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Delete snapshot completed successfully. Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-646c049e-db05-4826-bb14-c963de5ea981 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-620df52c-7751-4f37-b9af-61604d0111f7-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:10 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-4a526619-7a63-433e-8956-e02793a69512" returned: 0 in 0.440s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:10 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-4a526619-7a63-433e-8956-e02793a69512" released by "delete_volume" :: held 0.984s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Created reservations ['6b0cacd5-1ed4-40e4-b77b-c8eee8026d07', '4a339133-7e6c-4d85-9908-2ba8e11e9e26', 'adf178ec-fde3-4230-9528-d994e5778e05', '0a14f59a-dae5-4436-98a4-86997ec9ffcb'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:11 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:11 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:11 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.487s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:11 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Deleted volume successfully. Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-00105159-7252-4225-a65c-1c56320583ca tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-4a526619-7a63-433e-8956-e02793a69512-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Creating offline snapshot ddd1aa2a-c72d-439b-b409-89e488ebd96a of volume 8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d5e1e2-2b81-4a3e-bf99-b197f0e1552a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:11 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 Apr 14 03:08:11 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-b05ac433-bcb8-4cca-b5c3-353eb5282b66-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-b05ac433-bcb8-4cca-b5c3-353eb5282b66-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "cinder-quobyte-b05ac433-bcb8-4cca-b5c3-353eb5282b66" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:11 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-b05ac433-bcb8-4cca-b5c3-353eb5282b66" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a16586-5e18-4a5c-bf65-eaee8e8902f2]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:12 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 Apr 14 03:08:12 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-a3697b1e-2303-48a9-be80-e30374695742-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-a3697b1e-2303-48a9-be80-e30374695742-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-a3697b1e-2303-48a9-be80-e30374695742" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-a3697b1e-2303-48a9-be80-e30374695742" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb556c1-b5c8-4d2c-89d4-0259d6e38af9]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:12 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055" returned: 0 in 0.551s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:12 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a 1G Apr 14 03:08:12 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:12 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 Apr 14 03:08:12 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:12 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66" returned: 0 in 0.514s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:12 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66 Apr 14 03:08:12 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:12 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742" returned: 0 in 0.484s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:12 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742 Apr 14 03:08:12 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:12 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a 1G" returned: 0 in 0.539s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:12 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a Apr 14 03:08:12 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:12 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-b05ac433-bcb8-4cca-b5c3-353eb5282b66" returned: 0 in 0.440s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:12 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-quobyte-b05ac433-bcb8-4cca-b5c3-353eb5282b66" released by "delete_volume" :: held 0.989s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Created reservations ['aea8f54c-9e55-4dd1-801d-b2dfaf8cbe73', 'ef776a00-9f33-4f18-beb4-980dd7098a5b', '9dd1b845-4ca5-42b0-bc8f-a812331d3acc', 'ca020daa-b9d7-4844-80ae-8ff25b48d6ec'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:13 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:13 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:13 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-a3697b1e-2303-48a9-be80-e30374695742" returned: 0 in 0.453s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-a3697b1e-2303-48a9-be80-e30374695742" released by "delete_volume" :: held 0.959s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Created reservations ['e4f85c98-45df-4023-b4cd-2dbbcfc309b2', '08657e55-bc60-4143-a315-0b5129371186', '6d05a138-a48b-4db7-bef1-7291172ade22', 'f31eda84-c9e1-45ac-ad23-58f935d37980'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:13 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a" returned: 0 in 0.464s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:13 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a is being set with open permissions: ugo+rw Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:13 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a Apr 14 03:08:13 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:13 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:13 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:13 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.477s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:13 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Deleted volume successfully. Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6e0bd5c1-8fe8-4045-810d-894cd7660816 tempest-CreateVolumesFromSnapshotTest-114362163 None] Lock "cinder-b05ac433-bcb8-4cca-b5c3-353eb5282b66-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:13 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a" returned: 0 in 0.414s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:13 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:13 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.info Apr 14 03:08:13 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.436s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:13 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Deleted volume successfully. Apr 14 03:08:13 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-13f0ded8-23eb-42fc-aae2-b89814f3a2a9 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-a3697b1e-2303-48a9-be80-e30374695742-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:14 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.info" returned: 0 in 0.405s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:14 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.info is being set with open permissions: ugo+rw Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:14 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.info Apr 14 03:08:14 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-368b1bf8-2baf-42b5-9cde-ee68a5e5752b-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-368b1bf8-2baf-42b5-9cde-ee68a5e5752b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "cinder-quobyte-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[028470c1-77d0-4ceb-ac4f-1c7de913d5ba]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:14 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b Apr 14 03:08:14 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:14 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.info" returned: 0 in 0.482s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:14 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-ac74ecde-e861-4652-adcf-3965765e9692 tempest-SnapshotDependencyTests-110681998 None] Create snapshot completed successfully Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_service.periodic_task [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82473) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:14 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:14 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:14 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:15 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" returned: 0 in 0.590s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:15 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b Apr 14 03:08:15 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Flow 'volume_create_manager' (cc45e059-bdc6-48ef-aefd-574b6971b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b434f87-5c75-4531-9cbd-9bdd8e7325e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b434f87-5c75-4531-9cbd-9bdd8e7325e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a754c46-b158-4a9e-ba6f-b2b765dcec21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81eda3766130451e9e6719f793ccbb77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ddd1aa2a-c72d-439b-b409-89e488ebd96a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:08:15Z,use_quota=True,user_id='11afd34323d24fae9077c50db3a71ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a23e5e-14d7-4b25-8cb2-d9f140848b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a23e5e-14d7-4b25-8cb2-d9f140848b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da03281a-018b-4b91-a535-97bf14e8a2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da03281a-018b-4b91-a535-97bf14e8a2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a754c46-b158-4a9e-ba6f-b2b765dcec21', 'volume_name': 'volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21', 'volume_size': 1, 'snapshot_id': 'ddd1aa2a-c72d-439b-b409-89e488ebd96a'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb9e2e8-d28a-4df8-9fb6-5d8200713823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb9e2e8-d28a-4df8-9fb6-5d8200713823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb11819b-b6c0-4d03-bba7-106334f2e865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:15 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Volume 2a754c46-b158-4a9e-ba6f-b2b765dcec21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21', 'volume_size': 1, 'snapshot_id': 'ddd1aa2a-c72d-439b-b409-89e488ebd96a'} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-quobyte-ddd1aa2a-c72d-439b-b409-89e488ebd96a-2a754c46-b158-4a9e-ba6f-b2b765dcec21" by "_create_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-ddd1aa2a-c72d-439b-b409-89e488ebd96a-2a754c46-b158-4a9e-ba6f-b2b765dcec21" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Creating volume 2a754c46-b158-4a9e-ba6f-b2b765dcec21 from snapshot ddd1aa2a-c72d-439b-b409-89e488ebd96a {{(pid=82473) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-quobyte-2a754c46-b158-4a9e-ba6f-b2b765dcec21" by "_copy_volume_from_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-2a754c46-b158-4a9e-ba6f-b2b765dcec21" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] snapshot: ddd1aa2a-c72d-439b-b409-89e488ebd96a, volume: 2a754c46-b158-4a9e-ba6f-b2b765dcec21, {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e139a6-00e1-4117-8445-57c3d55bf34a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:15 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a Apr 14 03:08:15 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:15 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.644s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-fa3e209a-18bd-44e5-b004-0086dff43370 None None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:15 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" returned: 0 in 0.592s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-quobyte-368b1bf8-2baf-42b5-9cde-ee68a5e5752b" released by "delete_volume" :: held 1.206s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Created reservations ['0922f72e-590b-4683-8752-fb3b1eb8b5ab', '27b4fdec-9278-43c5-ad34-c263ad1465c6', '4cb954d4-7ba6-4961-863e-06bfa6f0737a', '372c71da-e1d2-47da-a188-3590b4f1b28b'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:15 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:15 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:15 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a" returned: 0 in 0.591s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Creating direct copy from snapshot {{(pid=82473) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec8b6a-c01e-4b23-a1c4-e1fdec663406]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:15 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:15 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 Apr 14 03:08:15 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:16 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.514s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:16 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Deleted volume successfully. Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-6f6c7736-d148-4cfa-b5c9-3a1ced81d0b3 tempest-VolumeDependencyTests-2099042358 None] Lock "cinder-368b1bf8-2baf-42b5-9cde-ee68a5e5752b-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Flow 'volume_create_manager' (624925e8-0b78-4be3-a645-a04c5c62c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4929cbd1-a298-49e2-acc3-0a39a254bfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4929cbd1-a298-49e2-acc3-0a39a254bfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706474d4-24b5-47eb-a598-9e63a129e254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb72d7abfa4dd2ad492472bc28cf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:08:16Z,use_quota=True,user_id='6be727fa96c54ea0847edaba6aa3b98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1b733c-0dfe-4925-9cb7-131419694ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1b733c-0dfe-4925-9cb7-131419694ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b7509f-f44a-45ab-a106-f7c42ae8c5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b7509f-f44a-45ab-a106-f7c42ae8c5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '706474d4-24b5-47eb-a598-9e63a129e254', 'volume_name': 'volume-706474d4-24b5-47eb-a598-9e63a129e254', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221dbc94-bd67-41bd-9971-780589d7023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221dbc94-bd67-41bd-9971-780589d7023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06fd388-b51a-4d19-8d4b-4a6e4609d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:16 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Volume 706474d4-24b5-47eb-a598-9e63a129e254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-706474d4-24b5-47eb-a598-9e63a129e254', 'volume_size': 1} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:16 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055" returned: 0 in 0.517s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG cinder.utils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Path /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 not found in is_blk_device check {{(pid=82473) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 14 03:08:16 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:16 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 Apr 14 03:08:16 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:18 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21" returned: 0 in 2.189s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:18 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ebfcb-855e-4096-ac62-b740311755c4]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:18 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:18 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 Apr 14 03:08:18 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:19 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055" returned: 0 in 0.575s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.image.image_utils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Image conversion details: src /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 {{(pid=82473) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 14 03:08:19 devstack cinder-volume[82473]: INFO cinder.image.image_utils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Converted 1024.00 MB image at 467.48 MB/s Apr 14 03:08:19 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 is being set with open permissions: ugo+rw Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:19 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 Apr 14 03:08:19 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:19 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21" returned: 0 in 0.419s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-2a754c46-b158-4a9e-ba6f-b2b765dcec21" released by "_copy_volume_from_snapshot" :: held 4.350s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-ddd1aa2a-c72d-439b-b409-89e488ebd96a-2a754c46-b158-4a9e-ba6f-b2b765dcec21" released by "_create_volume_from_snapshot" :: held 4.368s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.378s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.277s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706474d4-24b5-47eb-a598-9e63a129e254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb72d7abfa4dd2ad492472bc28cf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:08:16Z,use_quota=True,user_id='6be727fa96c54ea0847edaba6aa3b98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Creating volume 706474d4-24b5-47eb-a598-9e63a129e254 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:08:19 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:19 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 1073741824 Apr 14 03:08:19 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb11819b-b6c0-4d03-bba7-106334f2e865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21', 'volume_size': 1, 'snapshot_id': 'ddd1aa2a-c72d-439b-b409-89e488ebd96a'}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd934a1-0b6c-428d-b0a3-4991c4e7ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:19 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Volume volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 (2a754c46-b158-4a9e-ba6f-b2b765dcec21): created successfully Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd934a1-0b6c-428d-b0a3-4991c4e7ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:19 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Flow 'volume_create_manager' (cc45e059-bdc6-48ef-aefd-574b6971b022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:19 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-76828b96-6cd7-4aa4-a518-fc2c7a892b02 tempest-SnapshotDependencyTests-110681998 None] Created volume successfully. Apr 14 03:08:20 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 1073741824" returned: 0 in 0.475s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:20 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 Apr 14 03:08:20 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-ddd1aa2a-c72d-439b-b409-89e488ebd96a-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:20 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254" returned: 0 in 0.458s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-ddd1aa2a-c72d-439b-b409-89e488ebd96a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-quobyte-8f6391f8-570b-451d-a2e3-ccb3bdd33055" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06fd388-b51a-4d19-8d4b-4a6e4609d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-706474d4-24b5-47eb-a598-9e63a129e254', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d489f58b-7f69-4c84-a9cd-ff1814a44a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-8f6391f8-570b-451d-a2e3-ccb3bdd33055" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-quobyte-ddd1aa2a-c72d-439b-b409-89e488ebd96a" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:20 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Volume volume-706474d4-24b5-47eb-a598-9e63a129e254 (706474d4-24b5-47eb-a598-9e63a129e254): created successfully Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d489f58b-7f69-4c84-a9cd-ff1814a44a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Flow 'volume_create_manager' (624925e8-0b78-4be3-a645-a04c5c62c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-ddd1aa2a-c72d-439b-b409-89e488ebd96a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Deleting offline snapshot ddd1aa2a-c72d-439b-b409-89e488ebd96a of volume 8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] snapshot_file for this snap is: volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:08:20 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-d97170a6-e814-47f8-bc80-a2def8c959fa tempest-CinderUnicodeTest-27222374 None] Created volume successfully. Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca3337e-505c-4591-8bf5-fcc05c4d9f75]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:20 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:20 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a Apr 14 03:08:20 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:21 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a" returned: 0 in 0.452s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c1387-114e-4138-8b4b-e6e9f841cce7]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:21 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 Apr 14 03:08:21 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:21 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055" returned: 0 in 0.448s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:21 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a Apr 14 03:08:21 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG cinder.volume.flows.manager.create_volume [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82473) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Flow 'volume_create_manager' (7a26befb-44c3-41f4-9447-87373829a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7c779e-50b2-4521-89b9-fe26324f873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7c779e-50b2-4521-89b9-fe26324f873f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:08:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-261818482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20feee30-daaa-4df9-9a15-ab3552493414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb72d7abfa4dd2ad492472bc28cf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:08:22Z,use_quota=True,user_id='6be727fa96c54ea0847edaba6aa3b98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e819e80f-bbcb-4ff1-8d8b-61b4a42e8fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:21 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e819e80f-bbcb-4ff1-8d8b-61b4a42e8fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a12bfb7-0fe9-4ac7-90fd-19a7a393bf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a12bfb7-0fe9-4ac7-90fd-19a7a393bf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20feee30-daaa-4df9-9a15-ab3552493414', 'volume_name': 'volume-20feee30-daaa-4df9-9a15-ab3552493414', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b017f0-7a58-4b98-a466-a5e6f51e6e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b017f0-7a58-4b98-a466-a5e6f51e6e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b38203-6fc5-4808-99b3-322960ac03ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:22 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Volume 20feee30-daaa-4df9-9a15-ab3552493414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20feee30-daaa-4df9-9a15-ab3552493414', 'volume_size': 1} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T01:08:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-261818482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20feee30-daaa-4df9-9a15-ab3552493414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fb72d7abfa4dd2ad492472bc28cf87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T01:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T01:08:22Z,use_quota=True,user_id='6be727fa96c54ea0847edaba6aa3b98b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3914f6c-95f7-4617-8f6d-3dec43f3789b),volume_type_id=b3914f6c-95f7-4617-8f6d-3dec43f3789b)}" {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Creating volume 20feee30-daaa-4df9-9a15-ab3552493414 {{(pid=82473) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Selected osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c as target Quobyte volume. {{(pid=82473) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 14 03:08:22 devstack cinder-volume[82473]: INFO cinder.volume.drivers.remotefs [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] casted to osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 1073741824 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:22 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 1073741824 Apr 14 03:08:22 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:22 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:22 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a Apr 14 03:08:22 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:22 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055.ddd1aa2a-c72d-439b-b409-89e488ebd96a" returned: 0 in 0.416s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-ddd1aa2a-c72d-439b-b409-89e488ebd96a" released by "_delete_snapshot" :: held 1.839s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:22 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-8f6391f8-570b-451d-a2e3-ccb3bdd33055" released by "delete_snapshot" :: held 1.860s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 1073741824" returned: 0 in 0.480s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:22 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 Apr 14 03:08:22 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Created reservations ['cfe4857d-6040-481f-b3c9-b69a8f08154c', '5018e40f-001c-4370-97e0-b78c1816f35f', '711eade8-3bb0-4b72-8419-c10f845ab95f', '32d85af1-aae2-42d1-8821-ece486ae59f6'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:22 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Delete snapshot completed successfully. Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-9c0ea9b1-c0b0-422a-8080-6b56949b18ef tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-ddd1aa2a-c72d-439b-b409-89e488ebd96a-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-8f6391f8-570b-451d-a2e3-ccb3bdd33055-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-8f6391f8-570b-451d-a2e3-ccb3bdd33055-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-quobyte-8f6391f8-570b-451d-a2e3-ccb3bdd33055" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-8f6391f8-570b-451d-a2e3-ccb3bdd33055" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[438f674b-07ec-44ef-a395-c25c7a60650a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:22 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 Apr 14 03:08:22 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:22 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414" returned: 0 in 0.428s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'} {{(pid=82473) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b38203-6fc5-4808-99b3-322960ac03ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20feee30-daaa-4df9-9a15-ab3552493414', 'volume_size': 1}' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62006062-c673-44d9-b435-ba2d62ebd054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 14 03:08:22 devstack cinder-volume[82473]: INFO cinder.volume.flows.manager.create_volume [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Volume volume-20feee30-daaa-4df9-9a15-ab3552493414 (20feee30-daaa-4df9-9a15-ab3552493414): created successfully Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62006062-c673-44d9-b435-ba2d62ebd054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82473) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 14 03:08:22 devstack cinder-volume[82473]: DEBUG cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Flow 'volume_create_manager' (7a26befb-44c3-41f4-9447-87373829a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82473) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 14 03:08:22 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-48427312-5fb8-41cd-bddd-07f93296e5a8 tempest-CinderUnicodeTest-27222374 None] Created volume successfully. Apr 14 03:08:23 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055" returned: 0 in 0.481s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:23 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055 Apr 14 03:08:23 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:23 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-8f6391f8-570b-451d-a2e3-ccb3bdd33055" returned: 0 in 0.397s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-8f6391f8-570b-451d-a2e3-ccb3bdd33055" released by "delete_volume" :: held 0.904s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Created reservations ['d5155b60-04c9-4b2f-8d87-6dc36b52415b', 'fcba69ee-24f6-48f8-b281-b2b48b5c008b', '50c23717-03a7-4527-99df-2dd2b145f064', 'ed148f08-12cc-4207-ba82-ca9ec74c250b'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:23 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:23 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-2a754c46-b158-4a9e-ba6f-b2b765dcec21-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-2a754c46-b158-4a9e-ba6f-b2b765dcec21-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "cinder-quobyte-2a754c46-b158-4a9e-ba6f-b2b765dcec21" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-2a754c46-b158-4a9e-ba6f-b2b765dcec21" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa5e31a-9e32-41c2-bf06-183297ea5dd6]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:23 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:23 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 Apr 14 03:08:23 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:24 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.472s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:24 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Deleted volume successfully. Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-c4fa600a-e356-47b6-80fc-4212caae58c5 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-8f6391f8-570b-451d-a2e3-ccb3bdd33055-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Creating offline snapshot edd2c6d1-abaa-4713-984f-881cad2b1e54 of volume 20feee30-daaa-4df9-9a15-ab3552493414 {{(pid=82473) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[3776f68e-3d69-4361-a3d2-304e4ddac631]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:24 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 Apr 14 03:08:24 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:24 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21" returned: 0 in 0.521s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:24 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21 Apr 14 03:08:24 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:24 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414" returned: 0 in 0.500s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 1G {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:24 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 1G Apr 14 03:08:24 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:24 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-2a754c46-b158-4a9e-ba6f-b2b765dcec21" returned: 0 in 0.415s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-quobyte-2a754c46-b158-4a9e-ba6f-b2b765dcec21" released by "delete_volume" :: held 0.961s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Created reservations ['f9a4bf29-9c4e-4edc-954d-13811f341bae', 'f334d87e-031b-428d-ac94-9d06997f44da', 'a16b9620-8a5a-42ba-b31a-a4c7dd6afae7', '5f9ae575-adfa-4d56-9cb4-bdd4b8df23e2'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:24 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:24 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:24 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:25 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 1G" returned: 0 in 0.530s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20feee30-daaa-4df9-9a15-ab3552493414 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:25 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20feee30-daaa-4df9-9a15-ab3552493414 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 Apr 14 03:08:25 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:25 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.479s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:25 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:25 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Deleted volume successfully. Apr 14 03:08:25 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-3a7c2c37-b76b-416a-a004-94a4031a1a54 tempest-SnapshotDependencyTests-110681998 None] Lock "cinder-2a754c46-b158-4a9e-ba6f-b2b765dcec21-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:25 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20feee30-daaa-4df9-9a15-ab3552493414 -F qcow2 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54" returned: 0 in 0.473s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:25 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 is being set with open permissions: ugo+rw Apr 14 03:08:25 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:25 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 Apr 14 03:08:25 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:26 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54" returned: 0 in 0.457s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:26 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.info Apr 14 03:08:26 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:26 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.info" returned: 0 in 0.450s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:26 devstack cinder-volume[82473]: WARNING cinder.volume.drivers.remotefs [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.info is being set with open permissions: ugo+rw Apr 14 03:08:26 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.info {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:26 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.info Apr 14 03:08:26 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:27 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.info" returned: 0 in 0.478s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.952s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=191,cinder:UPDATE=269,cinder:INSERT=57,cinder:DELETE=27 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=209,cinder:UPDATE=294,cinder:INSERT=76,cinder:DELETE=24 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:08:27 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-52c189f6-dd39-4315-987d-26a8a9cd4018 tempest-CinderUnicodeTest-27222374 None] Create snapshot completed successfully Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Acquiring lock "cinder-edd2c6d1-abaa-4713-984f-881cad2b1e54-delete_snapshot" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Lock "cinder-edd2c6d1-abaa-4713-984f-881cad2b1e54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Acquiring lock "cinder-quobyte-20feee30-daaa-4df9-9a15-ab3552493414" by "delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Lock "cinder-quobyte-20feee30-daaa-4df9-9a15-ab3552493414" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Acquiring lock "cinder-quobyte-edd2c6d1-abaa-4713-984f-881cad2b1e54" by "_delete_snapshot" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Lock "cinder-quobyte-edd2c6d1-abaa-4713-984f-881cad2b1e54" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Deleting offline snapshot edd2c6d1-abaa-4713-984f-881cad2b1e54 of volume 20feee30-daaa-4df9-9a15-ab3552493414 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] snapshot_file for this snap is: volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 {{(pid=82473) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd22e4a-b57d-4220-b711-15498c65d40a]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:27 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 Apr 14 03:08:27 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:27 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54" returned: 0 in 0.545s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.remotefs [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20feee30-daaa-4df9-9a15-ab3552493414(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82473) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca427fc-b73d-4791-98a6-672fb0a39802]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:27 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:28 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 Apr 14 03:08:28 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:28 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414" returned: 0 in 0.540s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:28 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:28 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 Apr 14 03:08:28 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:29 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54" returned: 0 in 0.490s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:29 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54 Apr 14 03:08:29 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:29 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:29 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414.edd2c6d1-abaa-4713-984f-881cad2b1e54" returned: 0 in 0.484s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Lock "cinder-quobyte-edd2c6d1-abaa-4713-984f-881cad2b1e54" released by "_delete_snapshot" :: held 2.120s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Lock "cinder-quobyte-20feee30-daaa-4df9-9a15-ab3552493414" released by "delete_snapshot" :: held 2.132s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:29 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Created reservations ['36c573cc-1d21-4025-acf7-cec0854883b5', '70964c9c-6d82-4740-83d5-eed2fa650be0', 'e2813997-19e9-4227-aaa0-b13b235a9c6c', '531587e6-0633-4099-ba69-33f648251326'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:29 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Delete snapshot completed successfully. Apr 14 03:08:29 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-494ae5e0-4233-444e-801c-699cc872c27b tempest-CinderUnicodeTest-27222374 None] Lock "cinder-edd2c6d1-abaa-4713-984f-881cad2b1e54-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "cinder-20feee30-daaa-4df9-9a15-ab3552493414-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Lock "cinder-20feee30-daaa-4df9-9a15-ab3552493414-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "cinder-quobyte-20feee30-daaa-4df9-9a15-ab3552493414" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:30 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Lock "cinder-quobyte-20feee30-daaa-4df9-9a15-ab3552493414" acquired by "delete_volume" :: waited 0.008s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:30 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29c7921-7cbb-4dde-aea4-10a9eb8812e5]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:30 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:30 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 Apr 14 03:08:30 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:31 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414" returned: 0 in 0.472s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:31 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414 Apr 14 03:08:31 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:31 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-20feee30-daaa-4df9-9a15-ab3552493414" returned: 0 in 0.391s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Lock "cinder-quobyte-20feee30-daaa-4df9-9a15-ab3552493414" released by "delete_volume" :: held 0.896s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Created reservations ['f9b545f1-e04b-433e-b9c1-b2ad1d53e942', '27a7c62b-5cbc-453b-b822-4153bdb0e076', '5492d45f-bfd0-405d-8e93-d62b68d3cd67', 'bcfd217a-4c5f-4ff7-b20d-fea543884638'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:31 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:31 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "cinder-706474d4-24b5-47eb-a598-9e63a129e254-delete_volume" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Lock "cinder-706474d4-24b5-47eb-a598-9e63a129e254-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "cinder-quobyte-706474d4-24b5-47eb-a598-9e63a129e254" by "delete_volume" {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Lock "cinder-quobyte-706474d4-24b5-47eb-a598-9e63a129e254" acquired by "delete_volume" :: waited 0.009s {{(pid=82473) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo.privsep.daemon [-] privsep: reply[df81d165-b6b9-4573-a14f-b719198ca5ce]: (4, 'qcow2') {{(pid=83229) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 14 03:08:31 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:31 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 Apr 14 03:08:31 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:32 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.443s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:32 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Deleted volume successfully. Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-a823742b-2969-4022-892b-f50ed14689e6 tempest-CinderUnicodeTest-27222374 None] Lock "cinder-20feee30-daaa-4df9-9a15-ab3552493414-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:32 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254" returned: 0 in 0.465s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:32 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254 Apr 14 03:08:32 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:32 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947/volume-706474d4-24b5-47eb-a598-9e63a129e254" returned: 0 in 0.389s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Lock "cinder-quobyte-706474d4-24b5-47eb-a598-9e63a129e254" released by "delete_volume" :: held 0.878s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG cinder.quota [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Created reservations ['05b44fa5-2d32-4f1b-8187-2fd20f9fe319', 'fe0f7b0c-0d7a-4d07-8575-3cb2bd6f28b8', '7381ef2b-5bb4-491a-bf74-fa4b91378fa5', '85de0a7f-0c0b-4873-8052-b4e278408f84'] {{(pid=82473) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c': None} {{(pid=82473) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG cinder.volume.drivers.quobyte [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ff60e8e1-014f-4763-a77d-c65d7a289e0c'] {{(pid=82473) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.lockutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82473) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 14 03:08:32 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 14 03:08:32 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947 Apr 14 03:08:32 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 14 03:08:33 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 14 03:08:33 devstack cinder-volume[82473]: DEBUG oslo_concurrency.processutils [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2cc3a97afcdbe5aa74b41414ef6ec947" returned: 0 in 0.469s {{(pid=82473) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 14 03:08:33 devstack cinder-volume[82473]: DEBUG cinder.manager [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Notifying Schedulers of capabilities ... {{(pid=82473) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 03:08:33 devstack cinder-volume[82473]: INFO cinder.volume.manager [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Deleted volume successfully. Apr 14 03:08:33 devstack cinder-volume[82473]: DEBUG cinder.coordination [None req-bd7c6750-6822-47d0-b3d8-1607ecc030c8 tempest-CinderUnicodeTest-27222374 None] Lock "cinder-706474d4-24b5-47eb-a598-9e63a129e254-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=82473) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 14 03:08:42 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 14 03:08:43 devstack cinder-volume[82473]: DEBUG dbcounter [-] [82473] Writing DB stats cinder:DELETE=2,cinder:SELECT=19,cinder:INSERT=11,cinder:UPDATE=25 {{(pid=82473) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}